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FORBWORD 



This research and development was performed in support of the Navy 
Technical Information Presentation Program (NTIPP) under the auspices of 
the Naval Ship Research and Development Center, Bethesda, Maryland. NTIPP *s 
goal is to dovalop a systam of procaduraa and equipments designed to improve 
the utility, preparation, revision, storage, distribution, and management 
of technical information for the mid-1980s. This Center was tasked with 
investigating a problem fundamental to this goal— assessment of compre- 
hensibility and usability of graphic materials In technical information. 

This report, the first in a series, covers the first phase of this work. 
It details the findings of a study dealing with the location and identifi- 
cation of information on technical drawings, outlines Initial guidelines 
pertinent to graphic comprehenstbility, and provides an approach for further 
exploration of these critical issues. 



DONALD F. PARKER 
Commanding Officer 
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SUMMARY 

Problem 



Current graphic practices for technical manuals, as set forth In military 
specifications, standards, handbooks, and other publications, are rarely based 
on objective evidence that they Improve use and comprehension. Methods based 
on valid data are not currently available either for establishing requirements 
for procuring technical manuals or for objectively measuring a particular 
Illustration s effectiveness in supporting the Job performance of technical 
personnel* 

Objective 

The overall purpose of this research and development was to begin the 
development of empirically based guidelines and objective measurement 
techniques to increase the use of technical Illustrations. Toward this 
end, four specific objectives were established: 

f«ciLV,Mnf'^o!!'J^L^^^"^'*^ features that could be hypothesized as 

facilitating or inhibiting the use of illustrations. 

features!'' technical illustrations displaying variations of these 

4nfn^^Il"'2**'*''!u'^® performance of Navy technicians extracting selected 
information from these illustrations. 

research^*" evaluate the potential of the present methodology for future 
Approach 

arr-n^Lfnf selected for study were the number, sequence, and physical 
arrangement of callouts or index numbers used by technicians in locating or 
P^ioJJ^o ^^^"""tlons. Starting with two illustrations from 

existing technical manuals-a cross-sectional view and an exploded view^ 

^f""^^^ * '^""'^^'^ combinations. The experi- 

locating and Identifying target information, given selected 

af ^S8?Mr^J^^T?''K ^^^^f^ ^° «i»"l*te on-the-job tasks as realistically 
recu?r«d in ^If J .J^ amenable to precise measurement in terms of the time 
senailtf r«t?Z . task. Subjects were 2A3 Navy enlisted men in three 

lllustwti^s? familiar to some extent with the use of technical 

Findings 

calloit nu^ben °' " °" ^ illustration when given a 
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a . Wh«ti numbers wer« in sequence » there wis iittW 4ill***Wl# III 

search time as the number of callouts increased from 10 to 62. 

b. When numbers were in random order, search time increased by a 
factor of three or four as the number of callouts increased from 10 to 62 ♦ 

c. Including both the nomenclature and the number in the callout did 
not interfere with the search for a number. 

2. For the task of finding a part on an illustration when given the 
nomenclature of that part (with the nomenclature either in the callout itself 
or in an accompanying table): 

a. For 10 callouts, scanning nomenclature callouts was more efficient 
than using a table. 

b. When the number of callouts was larger (27 o" greater), searching 
a table, even when not alphabetical, was superior to scanning nomenclature 
callouts on the drawing itself. 

♦ 

c. As th<i number of callouts increased from 10 to 62, median search 
time increased by a factor of about six. 

d. When callouts contained both numbers and nomenclature, the numbers 
tended to interfere with finding a part name. 

3. For the task of giving the nomenclature of a marked part (using either 
nomenclature in the callout itself or in an accompanying table): 

a. There was a small increase in search time from 10 to 27 callouts 
when a table was used, and no increase beyond that. 

b. Where nomenclature was in the callouts, increasing the number of 
callouts yielded no difference in response time. 

c. For 10 callouts, using a table or having numbers in the callout 
itself were equally efficient; for larger numbers of callouts, there was an 
advantage to having nomenclature in the callouts even when the number of 
callouts was large and the drawing appeared cluttered. 

4. Findings with regard to the physical appearance of callouts (e.g., the 
circling of a number versus not circling it) were inconsistent but appeared 
weak in comparison with the effects of sheer number of callouts and the 
sequence versus random variable. 

5. The general methodology employed was found to be flexible and 
relatively efficient and allowed for variations depending on the particular 
type ot task in which the technician might be engaged. 
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1, For part location by eallout nuabtr, alwayt arrange th« calloutt in 
nuatrlcal ordor* 



2. For part location by nonandaturt, uta noaandatura callouta if the 
nuabar of callouta la 10 or laaa; otharwlaa, uaa nuidimr callouta In aaquanca 
keyed to an alphabetical table* 

3. For part Identification (finding the noaendature whan the location 

la known), uaa nomenclature callouta evan when the number of callouta la large 
and the drawing looka duttared. There are no data on the upper Halt. 

4. If the numbera are In aequence, then'<devlce8 to enhance die crimination 
and vlaual acannlng, auch aa circling and aligning the callout numbera, are 
probably unneceeaary. 

5. Zonea are not uaeful for locating parte when a callout nuiniber muat 
alao be uaed for verification* 

6. Since the guidelinea differ with the type of information-aearch taak, 
each drawing must be designed for the specific taak it la Intended to aupport. 

7. Although it appeara promising to Isolate the information-aearch 
behaviors of technical manual uaers and to vary the drawing featurea that 
Influence aearch apeed and accuracy, care must be taken in future atudlea to 
randomise, counterbalance, or measure the effect of target location in the 
stlmulua materials. 

8. Clarification of the graphic comprehenaion laaue should be pursued 
through empirical studies of users* information-aearch behavior and the 
stimulus varlatlona that Influence Ita effectlveneaa. 
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INTRODUCTION 



Problem 



Sine* illustrations »ay easily make up 50 percent or raore of a technical 
manual, the effectiveness of graphics in communicating technical Information 
Is critical. Requirements for current graphic practices, as set forth in 
military specifications, standards, handbooks, and other publications, are 
rarely based on objective evidence that they improve technical manual use 
and comprehension. Requirements in different documents sometimes contradict 
each other. At present, there are no methods based on valid data either for 
establishing requirements for procuring technical manuals or for objectively 
Measuring a particular illustration's effectiveness in supporting the Job 
performance of technical personnel. 



The overall objective of this research was to begin development of 
empirically based guidelines and objective measurement techniques to Increase 
the use of illustrations in technical manuals. 

The specific objectives of this study were: 

1. To identify a limited set of features that can be hypothesized as 
either facilitating or inhibiting the use of illustrations. 

2. To construct technical illustrations displaying variations of these 
features . 



3. To measure the performance of Navy technicians in extracting selected 
Information from the illustrations. 

By systematically varying a small number of well-defined features and 
objectively measuring the effect on specific tasks simulating actual use, the 
following goals can he achieved: 

1. A quantitative inaex of effectiveness, such as tlme-to-locate- 
information, can be associated with variations of specific features as a 
step towards a more generalized graphic compr.2hensibility measure. 

2. Requirements in specifications and guides can be made less arbitrary 
by basing them on performance data. 

Background 

Current Status 



In a recent comprehensive survey of tecbnicaJ manual comprehension. 
Curran (1977) concluded that: 



Objective 





time if lLa«^ dl^ E^^^^ 

various kinds and their relationship to the comprehension 
ot that illustration* The guidance which is offered technical 
illustrators is for the most part intuitive; virtually, no 
empirical evidence is available* 

rh*»rt' havt> , of course, been serious efforts to control characteristics of 
irtwork in tpchnical manuals to facilitate the transfer of information to the 
I . At least two major approaches can be cited, 

Hu' tirst approach is to implement an entire philosophy of how technical 
inti>rmatu)n is best presented. This is done through a set of procurement 
l»K umrnts dptailinR the characteristics of the manual and often the processes 
f V whK h t product is to be achieved. Examples are the Functionally 
^'i i» nt» il Maintenance Manuals (FOMM), Fully Proceduralized Job Performance Ai • 
'KJ ifV\)» NAVAlR's Work Package concept, and the Array's Integrated Technical 

unuMU it ion and Training (ITDT) program. Artwork requirements, often quite 
. If t. ill 111, are dt»v6>loped on the basis of general experience, opinion, aesthetic 
» nsid^-rat ions, past practice, reactions against past practice, and reasoning 
tT ..;:i t tu' i>vt»rall philosophy. Once the requirements are set forth in 

.;r.'t:Hiir ilooumonts, technical manuals are procured in conformance with 
M.f.:. . jiui It IS nearly impossible to investigate the impact on user 

t I Minaiu f ot systematically varying the more arbitrary aspects of the 
t ' 'III i r »'iut* n T s . 

\h' stMi>nil approach is represented by several recent studies aimed at 
' Jt)n>; (1) personnel characteristics such as test scores, rating, reading 
*^ !itv, and experience level, (2) characteristics of the task and the work 

• J!" 1 r ^vimmt , and ('3) optimuTii modes and formats of data presentation. Recent 
wmj* stK.nsored by the Navy Technical Information Presentation Program (NTIPP) 
;r >vidt»s tht» heginninj;s of a model by which the best type of graphic 

I I . st'Mt ;it I t)n can be selected for a given set of personnel, task, and 

• "iv 1 i^MimeiU a 1 factors. This approach thus far has been concerned only with 
i *H vfio;v »» 1)1 overall type of format. Having recommended, for example, an 
•^l I Mifd virw ot an assembly, it makes no recommendations about features of 
? t h ?wiiu' itselt that may make it easy or difficult to use. 

^^•»t»i .it tht^'st* are positive and important approaches in that they focus on 
.}l M iti/ t»»vhnical information to match the user^s characteristics, needs, 
I ! 1 w.M k »Mwironment. The present NTIPP-sponsored study, howevar, is believed 

* t tit St <»mploy the detailed analysis and objective validation 
• . I" ! t > ad<irt\SH the pr()blem of establishing requirements for procuring 
»^^) ^ N uitormati<m or for objectively measuring the effectiveness of a 
. »'M.!.i4r ill ist rat ion in supporting job performance. 

.t'.»r d.-al ot technical artwork is controlled by MIL-STD-100 
? I I { r I iiv. Drawing Practices). For economic reasons, preparers of technical 
Hni.tl*; ill' ♦MU'ouraged to use or adapt engineering drawings, sin^^c removing 
'M.iP.MMs ;n.»trrial from existing drawings is less costly than producing new 
. tw 'il^ »\[i «'-slv desiHne<i for th^ maintaini r or operator. Because of a lack 
' J ;» »»i T»'sparvh rt'prc^^ent ed by the present study, it is not clear that 
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1 ^^^^-- ^••4l««* to ««f»t-4;h« n99dB of dteigntrt «nd buiU<rt «rf osfillil fat 

miintiiners and operators, or" to what degree and in what ways they are 
suboptinal. Casual examination of engineering drawings suggests several ways 
to improve such drawings for maintainer or operator use. Without empirical 
data on the effects of using current engineering drawing practices to produce 
artwork to support Navy technician performance, it is impossible to estimate 
long run cost/benefit ratios as an alternative to immediate cost savings in 
artwork production. 

Guiding Assumptions 

To provide an orientation for the development of specific studies of the 
interaction between a user and graphically presented data, the following 
principles or assumptions were formulated: 

1. At certain points in the user's overall sequence of maintenance or 
operator actions, the user refers to graphic presentations, using currently 
available data (entry information) to begin a search (which may be simple or 
complex) for needed data (target information). 

2. Certain identifiable characteristics of arrangement, labeling, 
referencing, and drawing practices can influence the efficiency of the search. 
The particular combination of factors contributing to an efficient search will 
depend on the entry information and the target information. Graphic 
presentations designed for one type of search will not necessarily be most 
efficient for another type. 

3. In some cases, the beginning and end points of the information search 
are relatively easy to identify. Early research should focus on such cases, 
both to generate knowledge about them and to provide insights into methodology 
for less obvious and more complex user activities. 

4. The user is generally not aware of the details of the data extraction 
pocess or of the factors that optimize or degrade it. The user's opinion 
about good and bad artwork can suggest clues for further investigation, but 
only direct performance measurement should be considered conclusive. The user 
may become aware of the search process if it becomes unusually difficult or 
time-consuming, but even then the needed improvements may not be obvious. The 
user's attention is not focused on the data extraction process itself, nor 
should it be; an efficient search for data will be as short, automatic, and 
unintrusive as possible. 

5. Even if an illustrator were inclined to consider the search chain from 
entry information to target information, the most effective combination of 
characteristics is not always obvious. 

6. Aesthetic considerations alone will not guarantee optimal usefulness 
and may sometimes result in degrading use. It may be necessary to violate 
aesthetic principles to optimize information search. For example, it may 

be most beneficinl to user performance to get a great deal of information 
on a single drawing, even though the drawing looks cluttered. 
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1 . The cowprehenBlon or usefulness of a graphic presentation Is not a 

property of the presentation alone, but depends on what information is being 
sought trom it at a particular momenta It reflects a relationship between the 
<4iarac ter ist ics of the graphic presentation and the task being performed at 
that moment. Therefore, an index of usability or comprehensibility that does 
not take the intended use into account is seriously deficient* 

Definition of a Specific Problem for Study 

Two important assumptions are (1) that an illustration's intended use is 
critical in t^valuating its usefulness, and (2) that the evaluation must be 
made in terms of measures ot user performance. Because of these, certain 
interesting types of graphics are almost automatically excluded. For example, 
complex cognitive tasks (e.g., troubleshooting) and the illustrations that 
support them (e.g., schematics, block diagrams) were not considered amenable 
at this time to a fine-grained objective study. It^s expected that the type 
of research represented by the present study will suggest ways of objectively 
studying these other important graphic types and the behaviors associated with 
tht^m. 

Location and identification of parts, however, were judged to be highly 
suitable Uv^er activities for the present study for the following reasons: 

1. They are common activities among technical manual users. 

2. They are supported by a number of different types of drawings; for 
t>xample, isometric drawings, cross-sectional views, exploded views, 

c ircui t-*board drawings, and control-panel drawings. 

3. Elements of the drawings that are intended to support this type of 
search, such as callouts and zones, are obvious. Varying these elements for 
experimental purposes is not difficult* 

4. Advice and requirements relating to these elements are not always 
consisteiu, and sometimes appear to derive from considerations of aesthetics 
and contractor convenience rather than effectiveness and user convenience. 

Apparent violations <'^f human factors considerations and even common 
stMist* ari» not difficult to find in recent technical manuals. 

f> . Tht* us%»r's information search task can be easily and realistically 
s imu l.jt fd wi t h exper imenta 1 c<Mit rol s . 

KvtMi though the prt^stMit study has be<Mi limited to part location and 
idtMU 1 1 icat i on , tl)e scopt» ol questions that might be asked is still very broad 
and ln^ludi^s tht» following: 

1. Shouhl numbt>r<?d callouts bt* in sequence? What price in efficiency is 
{>.n.vi ii tht»v are notV Art* tht>r*» cases wht^re numerical sequence is 
un I mp« ) r t aw t * 
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2. What is the naxinum numbar of e«llout« that should appear on a 

drawing? Do number callouts and nomenclature callouts differ in this respect? 

3. What is the trade-off between having nomenclature callouts on the 
drawing versus putting the nomenclature in a table keyed to number callouts? 

4. When reference designators are used as callouts, are they less 
discriminable than nomenclature or numbers, and therefore harder for a user to 
find quickly? 

5. Do graphic devices such as circling the numbers or using large, bold 
type help the user to scan more effectively? 

6. Should leaders (the line connecting the callout to the part) or arrows 
be short so that the callout is close to the part it identifies, or is 
scanning aided if the leaders are extended so that the callouts are arranged 
in straight lines? 

7. If alphanumeric zones are used, what zone size is most effective? 

8. Should the zone reference be keyed to the center of the part, the 
callout, or the arrowhead? 

9. Zone designators on engineering drawings use the lower right cor .er as 
the origin and run backwards from the normal reading direction (right to left 
and bottom to top). Does this degrade search perfoirmance? 

There are, of course, additional questions concerning the interaction of 
the various factors with each other and with the type of search being 
performed. Some of the above questions were addressed in the present study. 
To limit the scope of the present study, however, reference designators were 
not studied, and zones were represented only minimally to collect information 
for the design of a future study. 

Three common types of information search related to part location and 
identification were simulated in this study: 

1. A part is cited by callout number in a procedure, explanation, or 
description: Find the part in the drawing. 

2. A part is cited by nomenclature in a procedure, explanation, or 
description: Find the part in the drawing. 

3. A part location in a drawing is known (for instance, by recognizing 
its physical appearance): Find its nomenclature. 

Examj)les of the Problem Today 

The proper use of callouts and zones to aid the user may seem so simple 
and intuitive that some readers may doubt that a problem really exists. It is 
appropriate, therefore, to present examples of practices currently prescribed 
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and employed in technical illustrationa* Firsts examples are presented from 

textbooks, manuals, and military specifications and handbooks whose function 
is to guide in the production of technical artwork* Second, examples are 
taken from technical documents already in use in the Navy* It should be kept 
in mind that not all of these examples represent practices that always degrade 
performance; one of the major points in the present approach is that features 
contributing to usability will differ depending on how the illustration is to 
be used* 

Figure 1, an illustration from a mechanical drawing textbook (Giesecke, 
Mitchell, Spencer, & Hill, 1974, p* 419), is intended as an example of a 
correctly produced cross-sectional view and is a type of engineering drawing 
frequently reproduced "as is** in maintenance manuals* Its lack of numerical 
sequence in the placement of callouts is common in such drawings* An 
intuitive recommendation, corroborated by this experiment, is that finding 
information by means of callouts would be much more efficient if the callouts 
were in numerical sequence. 

Figure 2, found in another illustrating guidebook (French, Svensen, 
Helsel, & Urbanick, 1974, p* 494), is perhaps an even more severe violation of 
the same principle* Depending on the particular callout number selected, it 
may take a f rust rat ingly long time to locate a particular number on the 
drawing. This is a good example of the need to consider the intended use of 
the drawing. If the user enters the drawing with the name of the part and his 
goal is to find the location, then the parts list should probably be in 
alphabetical order and the callouts should be in numerical order. This task 
is made maximally difficult by the arrangement shown, because a random search 
is necessary for both the part name and the callout* If the task is to find 
the name of a part given its location or physical appearance, then the drawing 
is acceptable, since the callouts do not have to be searched and ordering the 
parts li' * by callout number is helpful. 

Civilian illustrating guides are not alone in providing questionable 
recommendations. A new Dol) publication. Technical Manual Writing Handbook 
(1977), contains the "wrong-r ight^' examples shown here as Figure 3* The 
message ot these examples is a warning against extending leaders (the lines 
connecting the numbers or nomenclatures to the parts) to obtain a simpler 
scanning pattv^rn. Although there is no evidence that user performance is 
aided by the **right'* approach or degraded by the **wrong" one, no mention is 
mado in the handbook of arranging callouts in sequence, which turns out to be 
a much more powerful variable in increasing scanning efficiency than length of 
leaders. Such misplaced emphasis apparently occurs because aesthetic 
considerations prevail in the nbsi^nce of hard evidence about the factors that 
actually enhance usability. 

Ki^urr 4 is taken irom a writing guide (Post & Price, 1974) that was 
prt»partHl under contract for the Naval Soa Systk^ms Command but was never used 
otticially tor TM acquisition. Because of the small number of callouts in the 
example, th»» lac*k of numt»rical sequence would probably cause little 
lii^t rr lorat iiHi in performance, but a principle is illustrated that would hv 
vietrimental wtien applied in other c ircumst;j ices . For example, a technical 

h 
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(Excerpted from Glesecke, Mitchell, Spencer, and Hill, "Technical Drawing," 
Copyright 1974, Macmlllan Publishing Co., Inc.) 

Figure I. Cross-sectional view from a mechanical drawing textbook with 
callouts numbered nonsequentlally . 
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3 Ptiol seat 

4 Wind^hi»»id 

5 forward canoDv 

6 Radar op^radon seal 
/ Aft canopy 

10 No«t landing gnar door forward 

1 1 Nosa la^i Itnq gear door aft 
'2 Hydraulic compartmant 

acc«a$ door 
t3 Norn landing gaar shock strut 



M Center fusalaga 

16 fu€\ tank door 

17 Engine access door 

18 Engine access door 

19 Engine access doof 

20 Engine access door 

21 AuxHmry engine atr door 

23 Arresting hook 

24 Aft fuselage 

25 Tail cone 

26 Rudder 
26 Stabiiator 



29 Center section wing 

30. Leading edge flap 

31. Main landing gear strut door 

32. Main landing gear inboard door 

33. Inboard spoiler 

34 Outt>oard apoiler 

35 Rap 
36. Aileron 

37 Speed brake 

36 Mam landing gear shock strut 

39. Outer wing 

40. Leading edge flap. outtMard 



41 Leading edge flap, inboard 

44. Missile rack 

45. Bomb rack 

46. Missile pylon 

47. External center«}ine fuel i 
49. Data link access door 

53. External wing fuel tank 

54. External wing fuel tank pylon 

55. Landing gaar door, outboard 

56. Boom IFR racaptaele accaaa door 

57. Fuel calf accaaa door 
62. Fuel caH accaaa door 



(Fxcorptrd worn Vronch , Svenson, Helsel, and Urbanick, "Mechanical Drawing." 
(:opvri>Uit 1948, Mt'C raw-Hi 11, Inc.) 

Figure J. An oxpJodod view from a mechanical drawing textbook in which 
both callout numbers and table items tend to increase the 
d i t t i cul t y oi its use • 
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Figure 3. Example of a questionable recommendation in a military style 
guide. ' 
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illustrator (f«rtieularly • novice, who it nost likely to be using such 
guides), in following the manual*s recommendations, might be very careful to 
avoid the use of long leaders, which may or may not be detrimental to the 
user, and pay no attention to the ordering of cal louts, which seriously 
affects search behavior. 

A military publication that also offers acceptable examples of "good" and 
"bad" graphic practices (Figures 5a and 5b) is NAVAIR's Technical Manual 
Preparation Guide (1975). Figure 5b is an interesting instance in which rigid 
adherence to a clockwise sequence of numbers might best be abandoned. Part 27 
is actually joined with part 13, and probably should follow part 13 in 
sequence. Therefore, rather than slavishly following the "clockwise" rule, 
the cal louts can be kept in sequence and at the same time show the actual 
interrelationship of the parts along the center (axis) line, as shown in 
Figure 5c. 

The technique of arranging cal louts in sequence is not a new development. 
It ia, in fact, prescribed by Military Specification MIL-M-38784A (1975), 
which contains DoD-wide requirements for technical manual s^yle and format. 
The specification states, "Index [callout] numbers for each separate figure 
shall start with Arabic number 1 and continue consecutively. Sequence shall 
be from top to bottom or clockwise, when possible." This requirement is 
weakened, however, when the specification states, "Item numbers on exploded 
views used to show assembly/disassembly shaTl be in disassembly order." In 
cases where the callout numbers are searched, even when the purpose of the 
drawing is to aid assembly or disassembly, sequential ordering would appear to 
be in the best interests of the user. The only exception might be in simple 
drawings with few callouts, where the callout number sequence is the only 
device used to indicate assembly or disassembly order, 

MIL-M-38784A states that leader lines "shall be uniform, short, and 
straight as possible." However, this "cosmetic" characteristic was tested in 
the present experiment (the condition referred to herein as "extending") and 
showed no conclusive effect on performance. Again, aesthetic considerations, 
rather than knowledge of effects on performance, seem to be the basis of 
requirements in the military specification. 

Another military specification, MIL-M-15071G, deals with content 
requirements for Navy technical manuals. Despite the fact that it requires 
conformance with MIL-M-38784A, its examples do not conform, as indicated by 
Figure 6, It states, as do other sources, that parts in an exploded view 
shall be arranged in "correct relative disassembly position." It says nothing 
directly about callout arrangement, but the implication of Figure 6 is clear. 
No consideration is given to aiding the user's search. 

A major question addressed in this experiment is the number of callouts 
that may be used on a given illustration and the interactions of other factors 
with that number. Post and Price (1974), under the heading "Pictorials 
Practices," recommended that callouts be limited to seven or less. No 
distinction was made between nomenclature and number callouts. This surely 
does not mean, for example, that on an 11 x 17 inch drawing there should be no 
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Figure 5c. Improvement of Figure 5b by adding an axis line and 
renumbering callouts. 
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more than seven number cellouti. Whet it doee mean, however, ie not clear. 
It seems to retommend that no more than seven callouts appear in a grid of 
some unspecified size. A similar warning appears in the NAVAIR guide, which 
states that there should be no more than five number callouts in any 
1-square-inch area. It further specifies that "...the average maximum number 
of callouts within a 7.x 9 inch area should be 70." This requirement is badly 
stated, since it would allow dense packing of callouts in some drawings as 
long as there were other drawings with low callout density to bring down the 
average. Whatever the origin and validity of these numerical limits, the 
authors of these documciits seem to believe that they are better than no 
guidelines at all. Reecdrch should be directed at establishing specific 
limits based on user performance. These limits would probably differ 
depending on whether callouts were numbers, nomenclature, reference 
designators, or combinations of these types. At this time, no one really 
kn^vs the maximum density of callouts with which a user can easily contend. 

Very little searching is required tw locate violations of the sort 
discussed above in virtually any type of Navy tec-mical manual for any type of 
system oi equipment. Appendix A contains six examples of the stimuli actually 
used in this experiment, all of which are variations of two actual technical 
manual illustrations, both of which were considered unacceptable for various 
reasons. Appendix B contains seven additional examples (reproduced actual 
size) f om different kinds of Navy manuals. 

Figure B-I is included for two reasons. First, its callout arrangement, 
while not as difficult to use as some others, is not in sequence, and callout 
numbers jump from one drawing in the figure to another and back again. If 
there are several drawings on a page, then callouts should probably be 
arranged in numerical order in each of the drawings, even if the drawings are 
intimately interrelated. Second, Figure B-1 is quite similar to the original 
of the cross-sectional drawing used as an experimental stimulus in the present 
study, including the hand lettering of numbers and nomenclature. With as few 
bailouts as are found on this drawing, the use of nomenclature in the callouts 
'it^ema appropriate. With relatively few callouts, if the user's task is to 
i.ientity a part, then it is probably more efficient if the nomenclature is in 
fh^- callout than if it is in an accompanying table. 

Kigurt> B-2 is from a different section of the same manual as Figure B-1. 
it IS legitimate to use such drawings, according to MIL-M-38784A, "provided 
ttu'v mt'et the reproducible [sic] requirements herein. Borders, title blocks, 
manufacturer's notes and irrelevant material shall be removed." In the case 
■t Figurt> B-2 there is severe "information compression" caused by reducing the 

of the original drawing, there is no organized callout sequence, and the 
manufarturer 's detailed information was not removed. Any one of these factors 
-ihoiihl havt> been cause for rejection of the drawing, but this illustration and 
'ii.inv others similar to it were accepted, at least for the preliminary manual. 

Figutf B- J IS taken from a sonar systems manual dealing with towed-array 

Hoists. It If included to illustrate a common problem, that Df undersized 

fi lof 111 tht« c. llouts. Another problem in Figure B-3 is that the leader linos 

it. drawn 111 suv h a way that they might be confused with the linos of tho 



15 

ERIC 



drawings Againi there is a lack of ayatematic organiaation of the numbers oo. 
the drawing. It is exceptionally difficult to get started on this drawing, 

that is, to locate callout number !• 

Figure B-4 is taken from an ordnance publication. The drawing includes 
essentially three different kinds of calloutSt Some callout numbers are 
circled, some are not, and some are ^*stacked," which many sources discourage 
(with no supporting empirical evidence). Common sense alone would suggest 
greater consistency in the physical characteristics of callouts on a drawing. 

Figure is taken from an engineering system technical manual (NAVSHIPS 

0951-010-0010). It suffers from the common faults of failing to order 
callouts systematically and of requiring the reader to jump back and forth 
between the figure's drawings to follow the numerical sequence. 

The fact that Figures B-1 through B-5 were taken from different types of 
Navy manuals indicates the widespread nature of the problems being addressed 
in this study and, consequently, the need for corrective action. 

The Naval Air vSystems Command has generally been much more consistent than 
otlu^r SYSCUMs, from the standpoint of aiding the user, in the illustration of 
its manuals. This tendency has been advanced by its "Work Package" concept, 
which makes use of a larger number of small, special-purpose illustrations 
rather than a smaller number of large, complex, general-purpose ones. (The 
Army's Integrated Technical Documentation and Training (ITDT) program is 
tostering the same trend.) Even NAVAIR technical information, however, is not 
tt>tally free of the types of problems discussed above. Figure B-6 illustrates 
the random order of callouts in a work package. The accompanying procedural 
steps illustrate what may be the cause of this problem in many cases: The 
..allotits are ordered as they are referred to in the procedure. This is common 
practice m both military and commercial drawings that support procedural 
steps, but it does the user no good to have the parts so numbered because the 
task dt>t»s u<U involve searching the steps for callout numbers. Upon 
tMicount t^r in^ a callout number in a procedural step, the user must search the 
il ra wing , which is whert* the numbers ought to be in sequence. Performance 
wi>uhl not bt» dt»graded in the least if the callout numbers were out of order in 
I hi- proci^uiura I st<*ps, but W(>u Id b*^ improved significantly if they were in 
oidi-r on the drawing. 

Ki^nr.^ H~;, trom NAVSHIPS 91921(A), Instruction Book for Radar Set 
AN/srs^lo, w.is considered so unsuitable for maintenance use that it was 
tfi»»i,ttni as .i stimulus lor tht* present experiment. In particular, note thi^ 
two 1 - uu h squart»s drawn on the illustration. As mentioned earlier, various 
siMitros .ulvist* limit inji> callouts to about five to seven per 1-square-^inch 
.ura» hut oru» o{ t ho s<juar»»s on Figure B-7 has 12 and the other has 11. 
Kt»qu I rt^ment s to limit call out dens i t y are obvious 1 y needed , but they should bt» 
I'^.iS'-ii »'u porformancr data, particularly since research to generate such data 
is u^Mth.M dittuult nor i»xpensive. 

Ih" tn.it trr ol /oimv; ( coor J mat t»s ) , a 1 1 hou^»h r«'co i v i ti^: minimal attenti(>n in 
f r. |'i.-soi,i siuilv, pioviilos 1 ntt*rest I TU*. «*xampl<*s ot tlu* ilt^arth (^t good 
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information on how to aid the user in locating parti. For example, 

MIL-M-15071G requires zoning as follows: 

Diagrams shall be divided into equally spaced horizontal zones 
(ordinates) designated A, B, etc., from bottom to top along 
the outside left and right borders. Diagrams shall be divided 
into equally spaced vertical zones (abscissa) designated 1, 2, 
3, etc., from right to left along the outside top and bottom 
borders. The zone size shall be as needed to clearly locate 
referenced points. 

Note that the required order of numbers and letters along the axes is the 
reverse of normal reading. Engineering drawings have zones arranged in this 
fashion, and the requirement in MIL~M-15071G is apparently intended to 
oliminate the need to redraw the axer. The benefit is to the producer of the 
drawing, not to the user . Zone size ip left largely to the discretion of the 
illustrator. It should not be difficult to develop data for a functional 
relationship between part density, zone size, and search performance to 
rmulate intelligent requirements. 

WS-10759 (NAVORD Specification/Purchase Description for Ordnance 
Publications), a specification frequently invoked by NAVSEA for weapon system 
manuals, requires zones as follows: 

Diagrams shall be divided into three horizontal zones 
(ordinates) with the lower zone designated A, the middle zone 
designated B, and the upper zone designated C outside the left 
and right borders. Diagrams shall be divided into vertical 
zones (abscissa) 4-3/4 inches wide final size, designated 1, 
2, 3, etc., from right to left outside the top and bottom 
border . 

The zones are again "backwards," but this time they are required to be quite 
large. 

As a final example of the range of variation. Figure 7 is taken from a 
Functionally Oriented Maintenance Manual (FOMM), NAVSEA 0967-LP-603-8030 . FOMM 
manuals are based on an explicit user-oriented approach. In this case the 
effort to aid the user rt'sulted in "overkill," thus increasing the difficulty 
of the user's search. The double indexing of zones to achieve 0.2-inch 
rosolution results in a cumbersome zone designation system (e.g., D.E/7.5). 
First, this places an unnecessary load on the immediate memory of the user and 
If ads to an increased chance of reading errors. Second, this degree of 
precision is not necessary to locate the parts quickly. Third, users are 
unable to track horizontally or vertically on the page to this degree of 
precision without an overlay grid or a straightedge. The result is that users 
quickly learn to read and remember only the major coordinates (e.g., D-7) and 
to locate the part accordingly. Users should not have to learn to ignore 
mtomiat ion that was put there to help them. 
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It it cU«r irom thete cxMplet that thtrt ii littlt •npirically battd 

information to guide illustrators in enhancing user performance, and intuition 
is an unreliable guide. Even conscious efforts to aid the user sometimes 
misfire. The necessary data would often not be difficult to obtain from the 
standpoint of methodology, but would require a large program of painstaking 
research. The present study is an effort to inspire such a program. 
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METHOD 



The general approach was to identify tasks that closely simulate what a 
technician does when he is using a graphic presentation to get needed 
information. These tasks were restricted to location and identification of 
parts by use of callouts with and without parts lists, and, to a minor extent, 
zones. As described below, variations in number, content, and arrangement of 
callouts were incorporated into drawings, were presented to subjects using 
five different types of task instructions, and were evaluated according to the 
time required for the specified information search. 

Illustration Types 

Stimulus variations were incorporated into two basic drawings taken from 
Navy technical manuals: a cross-sectional view (C/S) of an electric motor, 
taken from the AN/SPS-58 Radar Maintenance Manual (NAVSHIPS 0967-320-4040), 
and an exploded view (E/V) of a chart drive. These are typical of drawings 
found in all types of Navy technical manuals. The originals were modified to 
produce the experimental variations, examples of which are reproduced in 
Appendix A. All types of variation are illustrated in these examples. The 
original drawings appear as Figures A-2 and A-6, except that Figure A-2 was 
hand lettered in its original form. 

Variations of the C/S are not directly comparable to those of the E/V. In 
particular, the C/S as originally drawn had nomenclature callouts, which were 
retained in some of the variations. Because of the placement of callouts on 
the E/V, nomenclature callouts were completely impractical. 

Number of Callouts 

The number of callouts on a drawing was varied in four steps: 10, 27, 44, 
and 62. This variable was applied in identical fashion to both the C/S and 
the E/V. 

Arrangement and Content of Callouts 

There were 13 variations in the arrangement and content of callouts. The 
variations were based on two types of drawings (cross-sectional and exploded 
views), three methods of labeling (number, nomenclature, or both), and three 
treatment variables (callout order, number circling, and leader extension). 
Each of the treatment variables consisted of two levels: 

1. Order: Callouts could be arranged sequentially (SEQ) or at random 
( RAN ) . 

2. CirclinK: Numbers could be circled (C) to distinguish them from other 
flemonts of thp drawing, or could be not circled (NC). 

3. Extension: Callout leaders could be extended (E) to the drawing's 
edge ti) line up the callouts and make scanning easier, or have nonextended 
(NF.) h'aders at more uniform Ifngth. In the E conditions, callouts that could 



21 



not brought to the edge due to space limitations were lined up diagonally 

near the center of the drawing. 

Of the 13 variations^ 5 were applied to the C/S: 

1. Nomenclature only (NOMEN), 

2. Numbers in sequence (NUM-SEQ)* 

3* Numbers in random order (NUM-RAN), 

4, Nomenclature with numbers in sequence (N/N--SEQ). 

*>• Nomenclature? with numbers in random order (N/N-RAN), 

The remaining eight variations (illustrated in Figures A-l, A-3, A-4, and 
A~5) used only number cal louts: 



1. 


Sequent ial , 


circled, extended (SEQ/C/E), 


•7 

• 


Sequent ial , 


circled, not extended (SEQ/C/NE)* 




Sequent ial , 


not circled, extended (SEQ/NC/E)* 


4. 


Sequent ial , 


not circled, not extended (SEQ/NC/NE), 


5. 


Random, circled, extended (RAN/C/E). 


(>• 


Random, circled, not extended (RAN/C/NE)* 


7. 


Random, not 


circled, extended (RAN/NC/E). 


«. 


Random, not 


circled, not extended (RAN/NC/NE). 


|t»C t 


Tasks 





hiv»» subji»ct tasks wore defined that simulate user behavior in the work 
t»nvir4)nment . Knch is best described by its corresponding instruction to the 

sub jeo t : 

Ir '*Pi>int part with cal lout number X/* (Callout appears in a 

piiHtuiur** or »»quipmt»nt description referencing a figure.) 

J. **PiMnt io the part called Y." (Nomenclature appears in a procedure or 
• irsi r i pt itui rt»tt*renc ing a tigure.) 

1. ***lfll m»' thi* nomtMic 1 a t ure i>f th<» part marked in red/* (Physical 
appear. JOvf or hKation of tae pari is known, and the nomenclature is sought.) 

♦ * **i t\\v z^mv systiMn 1 1> point to the part with callout number X/* 
V NaiPi* »^imatif>n as m Task 1.) 



5, "Um tht son* tyttttB to point to the part calltd Y." (Sam altuation 

as Task 2.) 



The zone system refers to the alphanumeric coordinates appearing on the 
exploded view. Given the callout number or nomenclature, the subject must 
a table to lind the coordinates of the part. 

Test Items 



Figure 8 shows all possible combinations of task and stimulus variations. 
Each of these combinations defines a single test item that could potentially 
be administered to experimental subjects. A subset of 160 of these, indicated 
in Figure 8 by diagonal lines, was actually used in the experiment. 

Task 1 NOMEN would have necessitated the use of a table, and did not 
appear to lend itself to sufficiently interesting comparisons. For Tasks 4 
and 5, which involved the use of the zone system, the intent was to develop 
some preliminary information rather than to be exhaustive. It was decided 
that the zone system would be useful only in situations where there was a 
relatively large number of callouts in random order, so only these test items 
were used. 

Before each test item, the subject was given (1) background information to 
simulate what a user would ordinarily know about a drawing, (2) entry 
information, and (3) his task. Thus, in a typical test item, the subject 
would be told. The next drawing is the exploded view with callouts that have 
numbers out of order, point to the part with callout number 28. Go." The 
subject would then turn to the drawing and find the required part. 

Selection of Target Information 

For each test item, a part was selected whose location or identity was the 
target of the information search. Targets were selected with three primary 
criteria: 

« 

1. Responding to a test item should not aid the subject on a later item. 

2. Targets were selected equally from all areas of the drawings. 

3. Items differing only by the number of callouts were assigned targets 
that were not identical but that, to the extent possible, were in the same 
area of the drawing. 

Accompanying Tables 

In Tasks 2, 3, 4, and 5, the subject often required information that was 
not part of the callout. Tables (parts lists) were used to supply the missing 
information. In Tasks 2 and 3 the table provided the bridge between callout 
number and nomenclature, and in Tasks 4 and 5 the table provided zone 
information. AH tables were in the same format. The number of items in each 
table corresponded to the number of callouts on the drawing, and the items 
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CROSS-SECTION 
NOMEN 

NUM-SEQ 

NUM-RAN 

N/N-SEQ 

N/N-RAN 



TASK 1 
(48 Cells) 



Number of Cal louts 
10 27 44 62 




TASK 2 
(52 Cells) 

TASK 3 
(52 Cells) 

Number of Cal louts 
10 27 44 62 




TASK 4 
(4 Cells) 

TASK 5 
(4 Cells) 

Number of Cal louts 
10 27 44 62 



EXPLODED VIEW 
SEQ/C/E 

SEQ/C/NE 

SEQ/NC/E 

SEQ/NC/NE 

RAN/C/E 

RAN/C/NE 

RAN/NC/E 

RAN/NC/NE 
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KlKure H. Diagram ot experimental design; stimulus-task combinations 
used in study are cross-hatched; T indicates use of parts 
1 1st table required. 
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when entered by callout number, and less efficient when entered by 
nomenclature* No task required the subject to enter the table by zone 
designation* Test items that required the use of a table are indicated in 
Figure 8. 

Groups 

Preliminary trials using the stimulus materials indicated that to 
administer all 160 test items in one session would have been too fatiguing for 
the subject. Therefore, the 160 test items were divided into four groups of 
40, with the various levels of each independent variable represented equally 
in each group* One group of 40 test items was administered to each subject* 

Other Materials 

In addition to the drawings, which were bound in scrambled order for the 
subjects* use, there was a corresponding set of item description sheets to be 
read to the subjects in connection with each drawing. Before the test items 
were administered, each subject completed a data sheet that included rate, 
educational level. Navy schools attended, and shipboard experience. Standard 
explanations and instructions were read to the subjects. Since the 
experimenter's task was extremely tedious, all materials were organized for 
easy administration. 

Dependent Variable 

The response variable was the time in seconds (recorded to the nearest 
tenth) required to complete each information search. After reading the item 
description sheet, the experimenter said, "Go," whereupon the subject turned 
to the next drawing and the timing began. Timing continued until the subject 
either pointed at a part in the drawing or began to speak his response, as 
required. If the response was not correct, then the experimenter said, 
"That's not it," and resumed timing. 

Subjects 

Subjects were 243 Navy enlisted men in three different rating groups: 
Sonar Technician (ST), Gunner's Mate (GM), and Boiler Technician (BT). To 
examine the effect of different experience levels on performance, 40 ST 
"strikers" (seamen and below who are to be rated as STs upon completion of 
sonar "A" school) were tested. Table 1 compares these four groups on a 
variety of characteristics. The major factors noticed in this comparison are 

(1) the expected dissimilarity between the experienced and inexperienced STs, 

(2) the somewhat greater similarity between STs and BTs than between STs and 
GMs, and (3) the expected lower levels of education (on the average) for both 
GMs and BTs as compared to STs. 

Subjects were well-motivated and cooperative* Subjects' spontaneous 
comments indicated that the stimulus variations were obvious enough that the 
subjects could relate potential outcomes of the study to their own job tasks. 
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Table 1 



Summary of Subject Characteristics 



Rating Group/ 
Experience^ 


N 


AvsraRe Time 
in Navy (yrs) 


Education (Percentages) 
No H.S. Deg H.S. Deg Some Col 


E-1 


Rates (Percentages) 
E-2 E-3 E-4 E-5 E-6 E-7 


Sonar 

Technicians 
(High Exper.) 


144 


3.56 


1 


74 


25 




8 45 33 13 1 


Sonar 

Strikers 

(Low Exper.) ^ 


40 


.33 


5 


82 


13 


33 


12 55 — — — — 


Gunner's Mates 


31 


2.21 


26 


68 


6 




16 52 32 


Boiler 
Technicians 


28 


4.57 


U 

9 


75 


14 




7 43 36 14 — 



^Two different experience levels compared for Sonar rating only. 



These personnel were waiting for their Sonar "A" School to begin; none were rated as STs . 



The selection of an approach to data analysis must take into account the 
following considerations: 

K A cursory examination of the data indicated that the distributions are 
markedly skewed, as would be expected of time data of this sort. 

2. Means and variances of the distributions appear to be correlated 
substantially. 

3. Because the cells of the design are divided among four groups of 
subjects, the observations may not be statistically independent. 

4. It is necessary to make numerous tests of significance on the data, 
pooling observations from the same subjects and from different subjects in 
various combinations. 

Under these circumstances, the following was regarded as the most 
reasonable approach: 

1. Use appropriate nonparametric tests. There is evidence that the 
correlations among observations are negligible; the use of nonparametric tests 
appears justified. The Mann-Whitney U test for the two-sample case and the 
Kruskal-Wallis test for the k-sample case were selected because they are the 
most powerful nonparametric tests of their respective null hypotheses. 

2. Be conservative in selecting a significance level. When numerous 
tests are performed, it is expected that some of the "significant" differences 
will actually be due to chance. This is less likely if the significance level 
is conservative. Consider using p < .001 as the lowest acceptable level. 

3. Mathematically transform the scores to reduce the skewness and render 
the data more amenable to a standard analysis of variance. The reciprocal of 
time scores (which may be interpreted as a measure of speed) is often used 
with response time data for this purpose. 
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Test Item Distributions 



Appendix C contains descriptive data on the distribution of scores for 
each of the 160 test items. The tables in this appendix show the highest and 

lowest scores, the quartiles, the range, the interquartile range, the number 
of subjects, and the group to which the item was administered. These 
distributions are displayed in groups of four. For Tasks 1, 2, and 3 the 
distributions for the four nuraber-of-callout steps are shown together; thus, 
the effect of increasing the number of callouts can be seen directly. For 
Tasks 4 and 5 only four test items were administered; these are shown together 
(Tables C-39 and C~40). For each set of four test items, the result of the 
Kruskal-Wallis k-sample test is shown. Numerous other significance tests were 
performed and are cited in the text as appropriate. 

In general, a large proportion of the Kruskal-Wallis and Mann-Whitney 
tests indicated highly significant distribution differences among the various 
conditions. Since most of the significant differenc . were in the expected 
direction and were well beyond the .001 level, it appears reasonable to accept 
this as evidence that the factors that were varied did influence performance 
(search time). 

In addition, six analyses of variance were performed on the reciprocals of 
the time scores (Tasks 1, 2, and 3 for E/V and C/S separately). The E/V 
analyses used five factors (number of callouts, sequence, circling, extending, 
and subject group), and the C/S analyses used four (number of caPouts, 
sequence, presence of nomenclature, and subject group). Interaction tables 
were examined and compared with the results of the nonparametric tests. 

Sources of Extraneous Variability 

At a number of points in the data analysis, unexpected and inconsistent 
findings occurred. Examination of the stimulus materials disclosed two major 
causes for these unsystematic results: (1) the position of the target 
information in the table (for Task 2 only) with resulting differential search 
times, and (2) one or more perceptual phenomena (such as figure-ground effects 
or generalized scanning strategies) that are systematic across subjects but 
are unexplained so far. 

Table Search Time 

In Task 2 the subject must find the part name in a table, note the callout 
number associated with the part, and then locate that callout number on the 
drawing. The time recorded for each subject was measured from the moment he 
began to search the table to the moment he pointed to the correct part on the 
drawing. The total time, therefore, includes two separate activities: 
looking up the part name in the table and searching for the callout number on 
the drawing. For task realism these two activities were not experimentally 
separated in the administration of Task 2. Further, the start of the 
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reliable end points for the measurement of the time interval* 

A separate study was conducted to determine the average time required to 
?:cat€ items at varying "depths" in a table> Using a 62-item table, 16 part 
Will fill 

Fart names that might be ambiguous (e*g», "roller mounting plate," "roller 
mount") were avoided. Subjects were eld: "Starting at the top of the table, 

find the part called the and tell me iuj callout number." Times were 

measured from the moment the subject oriented himself to the table until he 
began to speak the callout number. 

The results of this table-search experiment are shown graphically in 
Figure 9. The darkened circles represe nt the inedian times required to locate 
target items in the table. The line through the data points represents a 
linear approximation to the data points* Each Task 2 data point was corrected 
by subtracting from the observed time the averag^^ table search time estimated 
trom the linear function derived above. Unless of <^ rwise specified, all 
comparisons -nvolving Task 2 data that are made bw*lo;* use the corrected times. 

Perceptual Processes 



The second source ot uncontrolled variability is not easily explained and 

oltt^rs n() method of correction. These perceptual phenomena were quite 
svstpmati across subjects and in no way would been predicted. Several 

t*xamph*s are provided to describe their effects. 

Figure D^-l is the cross-sectional view with 44 number callouts in random 
order • One Task 1 item required that subjects locate and point to the part 
with callout number 14. Taken in isolation, callout number 14 actually stands 
i>ut from the callouts surrounding it; that is, once located, it is 
perceptually prominent. The average time required to locate this item, 
however, ranged from 7.75 seconds for the STs to 19* 35 seconds for GMs, with 
Bis requiring 13»8 seconds. For each of the thre'^ groups, the time was from 
. tr^ I) seconds greater than for a corresponding item on a 62-cailouc drawing. 
!t IS hypothesized that the reason for these unanticipated findings is that a 
suhitut searching the drawing of Figure D-1 tends to "leap" from the 
?uM^.hh.n t^llour 2) to callout 3 (or vice versa) and tends not to see 

\^ \^ 'A »ni»MiiMi -utuTs i!i a similar fashion m certain tasks with the 

\\ \ ^'ww. In Fija^urt* D-2a , for Task 1, the target item is callout 

-'.imrM-r :>^. As with tht> preceding example, the callout appears in what might be 
-MvhriMi .1 pi-;^min(»nt position. Compare this drawing with Figure D-2b, the 
. i. .:i.iwi'?w' ^.)ut witli I al lours. It was hypothesized from the outset that» 
? • ». ffiuu's b» nik qual, ii Wtnild take longer to locate a target item 
' • Mii^: amt)nv ^allouts. The target item on Figure D-2b is 

•"^J • • wi::.ri ,ipp» i-s to (.^mbrdded among other numbers and should perhaps 

i*' ' • ;.f* hit at'tucil findings wrre the reverse of this 

• « \ f iiT* tt)i^M- Mub]t»ct groups* it took longer to locat<* 

' •■ • '« .ii! -m! it.iwiox; than \\ did to locatr numbrr 53 o\\ 



1 i 



ERIC 



\ 




— ' — ' — ^ — ' — ' — ' — ' — I — ^— ^ — ^ — , 

'<> '8 ^0 2t 24 26 2& 30 32 34 36 38 



*° *^ <6 4a 50 52 54 56 Sa 60 62 

TABLE ITEM NUMBER 



Figure 9. Plot, of required search time for items varying in location in a table. 
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tho 62-caUout drawing. The median timo« for tlm ft2-callout ccnditiort' were 

{.'»{), /.lO, .iml H.<»0 loi j-nmps S*l , OH, (unl llT, respectively. Kor 44 
».ilh>»iis, th.' lot rosjH)ndiii)'. I inu's wcif 8.')U, 15.45, and 11.00. Tin? 
I'xplan.it ion tor the apprirtMit ditticulty in locatine item number 28 might be 
similar to that proposed for the cross-sectional view. It may be hypothesized 
that, when scanning the callouts, a majority of people begin with a 
lett-to-right sequence corresponding to n,orraal reading habit. In Figure D-2a 
this abruptly becomes a top-to-bottom sequence at the upper right hand corner 
of thf drawing; (the location of callout number 28). In making this change of 
direct iv-)n, it is hypothesized that subjects tend to "cut the corner" and 
overlook the target item. On the 62-callout drawing, the number 53 is 
directly in the line of scan (right-to-left in this case) and is therefore 
located more easily. The callout arrangement of Figure 2 might alleviate such 
.1 prohlv-m, ami provides one type of stimulus pattern for checking the 
hypot he>, 1 s . 

A tiii.ll I'xampU^ ot tins problem's pervasiveness is illustrated by 
Figure the cross-set t ional view with both numbers and nomenclature for 

callouts. In Task 2, the subject is required to search the callouts to locate 
.1 part With a specified name. In Figure D-3, the target item is the FAN. The 
mtdian tunes required to locate the FAN were 1 1 . 75, 29.90, and 36.65 seconds 
tor STh, BTs, and GMs , respectively. Again, it may be supposed that subjects 
tail to perceive objects outside of a relatively narrow scan path— a scan path 
that IS determined by the physical arrangement of the objects being scanned. 
In this eas,', It would appear that the scan path is from item 46 to 58 to 16 
to AH (or the revers.- ot this order), and that number 30 (tne FAN) is masked 
I'v t 111 s pat t ern . 

It tni'^ explanat 1.111 is valid, then there is no easy "correction factor" 
til.. I rati h,. applu'd to tindiiigs resulting from this phenomenon as there was 
with t ahlr-search times. Further, from existing data it is difficult to 
predet an ro winch stimuli mi^'.ht be affected by this phenomenon. 

( t !>'..;- s<'< t lOIM 1 Vl fW 

Ihf I. suits tot tM<- < t oss-s.-i t ioiia 1 view are presented by subject task. 
Iti.- 111.1 ),.t luuliuKs ar.- (1) tti.it , in certain circumstances, sequential order oi 
tniinM.T .-.ill. nits is extrruielv important, and (?) that user characteristics 
•*■•'•■''••' "1 N.ivv tat in>;s mllunu-e seatv-h times. 

1 .1 I !• 1 (ill nil- 

111 Ii^k 1, ttif ni.st I ui t i.ui to t hf subject w.-is point to the part witli a 
• iv.Mi will.xit tuiinbfi , lot thf I rosH-sect lona 1 view vhis pertains to the 
. .'lul 1 1 i.-ii'. ni wluvii I Iw ..liloutK are either nutnhers only or both numbers and 
Mom.Tu- I ,it lit «• Iwilh a r.uuiom .nid sequential order in each case). Figure lO 
1 Must rat. -s th.- t i tid i iij.-. s m the condition where callouts are numbers only. 
•>iiuf the i.M .nui Hr samples had similar individual profiles for this 
•i 1 1 iiat 1..I, . tiH-v wei,> pool.'d tor the purposes ot this comparison. In tlie 
.. .11.1 1 1 1.111 with .Mily iu i.il louts, there is virtually no difference in the t irae 
'•' '••••u. t h.- I .11 v.. I n: torin.it i oil .it'pendetit upon either the subject 
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Figure 10. A comparison of Task 1 performance with sequence and 
random conditions for ST and GM/BT groups combined. 
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(rating) group or cillout ord«r« Thii ratult it found in n««rly tv«ry 

comparidon made, and unless a particular point is to be made with regard to 
the 10--callout case, it will not be discussed further • The lO-callout case 
was intended to represent a lower boundary condition~a number of callouts 
smalj enough so that other conditions would have little effect — and seems to 
have ^^ctioned adequately for this purpose* 

Piguye 10 illustrates the overall range of times for the two groups and 
the two Orders, rather than the individual data points. With 27 callouts, a 
divergence begins to be seen both between sequential and random orders and 
betweX the different rating groups. Although the differences here are not 
statistically significant and probably are of little or no practical 
significance, there is a tendency (even with as few as 27 callouts) for more 
time to be required when callouts are in random order than when they are in 
sequence. The evidence indicates that the break point between acceptable and 
unacceptable practices (e.g., sequential versus random order) occurs at about 
27 callouts. 

When searching for information among 44 callouts (and probably fewer, do%m 
to some point around 27), the ordering of callouts in sequence becomes more 
critical. In the case of STs, it takes an average of three to four, times as 
long to find a target item when the callouts are in random order as when they 
are in sequence. This difference is of high statistical significance and has 
great practical significance as well. It is also important to note that 
search time itself is not the only factor involved here. Users might very 
veil become frustrated when unable to find needed information quickly, and 
either ignore the drawing completely or use it inefficiently. In the 
44-^callout condition the STs and the GM/BT group differ greatly in the time 
required to locate the target information. As was pointed out earlier, the 
particular target item in this case was unexpectedly difficult to locate. 
Although the target item was identical for all subjects, the average times 
required to locate the item were 7.75, 13.80, and 19.35 seconds for the ST, 
BT, and GM groups, respectively. The difference between search times for the 
CMS and the STs is statistically significant, and the difference for the BTs 
and the STs approaches significance. These differences can be explained only 
in terms of differences among subject groups. 

With 62 callouts, the BT sample tended to take longer to locate the target 
information than did the GMs or STs. The search time differences between the 
combined GM/BT group and the ST group are not significant. 

Whon numbers and nomenclature both appear in the callout, and when the 
subject is asked to find the part with callout number X, the GM and BT groups 
tend to take longer than the ST sample, but this difference is probably too 
small to be of practical significance (e.g., an average of about 3 seconds 
with 62 callouts). Here, however, a general finding of some importance is 
that the appearance of nomenclature in the callout does not seriously 
interfere with the search for a particular callout number. Differences 
between numbers only and numbers with nomenclature are generally small. 
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Task 2 required the aubject, given the nomenclature « to locate the part on 
the illustration. This involved searching the drawing directly when the 
callouts were noaenclature alone or nomenclature with numbers » and searching 
first a table and then the drawing when the callouts were numbers only. The 
differences found for Task 2 with numbers only (after subtracting table~search 
times) are inconsistent. The expected differences between sequential and 
random orders occur, but little difference was found among rating groups. One 
exception to this was the unexpectedly long time required for the BT sample to 
locate the target information in the sequence condition with 62 callouts. 
That task took the BT group an average of 10.8 seconds, compared with 3.95 and 
4.70 seconds for GMs and STs, respectively. With the data available, this 
difference cannot be explained. 

When numbers and nomenclature were both included in the callout, the BT 
sample required a longer time, on the average, in both the sequential and 
random conditions, and the GM group required a much longer time in the random 
condition only. Figure 11 illustrates the profiles for the random condition. 
Note that, with 62 callouts, the ST group required an average of 11.75 seconds 
to locate the target information; the BT group, 29.9 seconds, and the GM 
group, 36.6 seconds. Assuming that these results generalise sufficiently, 
this is a situation in which consideration of user characteristics must have 
top priority. Even the ST sample had relatively long response times, and when 
another group takes three times as long, it is evident that relief is 
required. At least one of two steps should be taken: (1) ensure that 
callouts are ordered in sequence, and (2) reduce the number of callouts on the 
drawing. Again, note that, with as few as 10 callouts (and perhaps even with 
as many as 27), there is no great problem for any of the user groups sampled 
even if the callouts are in random order. 

Numbers with nomenclature in the callout actually interfered with the task 
when the task required locating a part by nomenclature. This is in contrast 
to the reciprocal: Nomenclature did not interfere with locating a part by 
number. Figure 12 illustrates this situation, giving the ranges of median 
response times across the three main subject samples. The comparison for 10 
callouts shows the two conditions to have a quite short and almost entirely 
overlapping range. In the 27-callout situation, the picture is unclear, with 
the ranges appearing unexpectedly large relative to the 10- and 44-callout 
ranges. A clear pattern emerges for 44 and 62 callouts, however. The ranges 
for the nomenclature-only condition are relatively short and the times 
involved are relatively low. The ranges for the nomenclature-plus-number 
conditions are nonoverlapping with nomenclature only and are considerably 
higher. This suggests that, if the intended use of the drawing is the 
location of information on the basis of part nomenclature, then numbers should 
be omitted. Probably the best arrangement for a Task 2 search, although not 
directly tested in this experiment, is to use nomenclature only if there are 
10 callouts or fewer, and otherwise to use numbers in sequence keyed to an 
alphabetical table. 
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Figure 12, 



Ranges of median response times given nomenclature only or 
nomenclature plus numbers in Task 2 for ST, BT, and GM 
groups combined. 
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tank 3 Findings " 



In Task 3 the subject was to tell the name 6f a part marked in red. As in 
Task 2, tables were required for some conditions*\ For these, the subject 
found the callout number in the drawing and used that number to enter the 
table. Since the tables were organised according callout number sequence, 
the tables were efficiently designed for this type of response, and the times 
are uniformly short. With 10 callouts there was no difference between having 
the nomenclature in the callouts and using a separate Vable. For larger 
numbers of callouts, there appears to be an advantage t^having the 
nomenclature in the callouts, even when the number of caMouts is large. In 
general, there appears to be some increase in search time\i8 the number of 
callouts increases from 10 to 27, but not much difference fpr subsequent 
increases. \ 

For the conditions in which the nomenclature was contained in the 
callouts I there were no differences clearly attributable to an increased 
number of callouts, and no differences were expected^ Similarly, in the 
number-plus-nomenclature conditions, there was no difference in identifying 
the nomenclature of the marked part when the callouts were in sequential or 
random order. This finding does not argue for the use of random order of 
numbers in cal louts « As discussed under Task 2 above, if the drawing's only 
use ii to determine the nomenclature of a part whose location is known> then 
the use of numbers in the callout is unnecessary« If the numbers might have 
to be used in addition to the nomenclature > then the results from Task 1 and 
Task 2 responses indicate that the callout numbers should always be in 
sequence* 

Summary of Findings for Cross-sectional View 

I* Throughout the analysis of the cross-sectional drawing results, GMs 
and BTs tended to take longer to find the target information than did the STs* 
Whether this is a function of aptitude differences or of a mechanical versus 
electronic orientation is not known, but it clearly points to the fact that 
optimally designed drawings for different user groups may not be the same. 

2« When the number of numerical callouts reaches about 27, their order 
begins to become important. Search time may increase by a factor of three or 
four if the callouts are not in sequence. It is recommended that, even with 
very few callouts, the numbers be organised in sequence so that such 
organization becomes standard and can be expected by the user. 

3. If the intended purpose of a drawing is to locate a part whose callout 
number is known, then numbers alone or both numbers and nomenclature are 
equally efficient. If this is the drawing's sole purpose, the inclusion of 
nomenclature in addition to numbers would increase the drawing's cost without 
significantly improving its utility. 

4« If the intended purpose of a drawing is to locate a part whose 
nomenclature is known, then the inclusion of numbers in addition to 
nomenclature will interfere with the task« 
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61 a part whose location is known (Task 3), then there is^little to be said 
regarding any of the variables studied here, except for the order of items in 
HHiS; numbers alone are used in the callouts, then they should be in 
sequence (for standardization purposes) and the items in the table should be 
ordared according to callout numbers rather than alphabetically. 

Exploded View 

The results for random versus sequential order of callouts were quite 
conclusive, as were those for the cross-sectional view. Circling, extending 
leaders, and using zones produced mixed and inconclut ve findings. 
Differences between experienced STs and inexperiencea ST "strikers" were not 
significant, but differences were discovered between experienced STs and the 
GM and BT samples. 

Random (RAN) and Sequential (SEQ) Order 

The variations imposed upon the exploded view had the form of a 2 x 2 x 2 
factorial design. The factors were random versus senuential order, circled 
versus none ire led numbers, and extended versus nonexttr. :.d leaders. As 
expected, the order of the number callouts was again the most powerful 
variable manipulated in this study. 

In virtually every case in which the number of callouts was 27 or greater, 
the time required to locate a number when callouts were in random order was 
significantly longer than when callouts were in sequence. For Tasks 1, 2, and 
3, withm each number-of-cal louts step and for each subject group, the SEQ 
conditions were combined and contrasted with the RAN conditions. Tables 2, 3, 
and 4 show median response times according to number of callouts and ratina 
group for Tasks 1, 2, and 3, respectively. 

Task 1 Findings. For Task 1 ("Point to the part with callout number X"). 
Table 2 shows that when the numbers are in sequence, the time required to 
locate a target item is essentially no different when there are 10, 27, 44, or 
62 callouts. Figures 13 and 14 illustrate the Task 1 performance of GMs and 
BT8 as compared to STs.^ The curves for callouts in sequence are nearly 
horizontal; the differences that are seen are nonsystematic and statistically 
nonsignificant. The fact that no differences were found for callouts in 
sequence, even between 10 and 62 callouts, is itself an important finding. 
Although one might have expected a gradual increase in the time required to 
locate information as the number of callouts increased, none occurred. The 
small differences in the profiles are most likely due to experimental error 
rather than to any differences inherent in the stimuli. Knowing that a coming 



Experienced STs will again be used as the anchor group in these 
comparisons. Inexperienced ST strikers were sufficiently similar to the 
experienced group that they will not be discussed further. 
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Table 2 



Task 1, Exploded View, SEQ and RAN 
Median Response Times: $T(H1), ST(Lo) , GM, BT 













Rating Group 


10 


27 


AA 


62 




Task 


1 SEQ 






ST (HI) 


2.00 


2.50 


2.15 


2.10 


ST (Lo) 


2.38 


2.63 


2.23 


2.03 


GM 


2. A3 


3.55 


2.85 


3.38 


BT 


3.00 


4.60 


2.80 


2.65 




Task 


1 RAN 






ST (HI) 


2.55 


3.55 


6.80 


7.65 


ST (Lo) 


2.85 


A. 08 


6.A8 


10.83 


GM 


3.17 


A. AO 


6.73 


11.10 


BT 


3.15 


5.10 


10.85 


10.95 



AO 




— 1 — ^ 1 I 

10 27 44 62 

NUMBER OF CALLOUTS 

igure 13. A comparison of Task 1 performance of ST and GM groups on 
exploded view, sequence and random conditioas. 
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Kigurt' I/*. A comparison of Task I performance of ST and BT groups on 
exploded view, sequence and random conditions. 



42 



•ti«uLut irouU have calloutft in ttqutnca 4pp*r«iitly aX«rt«d tba ^ubjtct «• to 

xJHere his ie^irch ahould begin and how it should proceed. If this orientation 
response generalites to actual job tasks » then the user's task would be 
>?reatly simplified by the knowledge that callouts would always be in sequence. 

When callouts are in random order, on the oth^r handy there is a 

significant increase in the time required to locate information as the number 
'f callouts increases. Note in Figures 13 and 14 that, for all groups, the 
time required in the 62-caliout situation is three or more times that required 
wtieu there are 10 callouts. Similarly, the time required for the 62-callout 
' ondir. ion wh^n the numbers are in random order is from two to four times as 
long afl the analogous situation when the numbers are in sequence. Finally, 
both the GMs and BTs tend to take significantly longer than the STs when there 
^re bJ. - allouts, and the BTs take significantly longer when there are 44 

louts as well. It is apparent again that the GMs and BTs experience more 
fficult y than STs when the number of callouts reaches 44, and considerably 
t^.»rt» 'iifticuir. V for 62 callouts. 

lask 2 Findings . Task 2 profiles comparing GMs and BTs with STs can be 
^iMr-n in Table 3 and in Figures 15 and 16, respectively. In Task 2 the subject 
ntist search tor a part name in a table> determine the callout number for that 
i»att, and then locate that number on the drawing. As mentioned earlier, the 
time increment (based on a study of STs) required to search the table is 
su<jtr«cted out of total time before comparisons are made on this task. 
Figures 15 and 16 show only this corrected time. When callouts are in 
Mi^quenLe, there is a much greater tendency toward an increase in the time 
Tt>c(uired as the number cf cal-outs increases. The time required (after the 
. jrrt^ctum has been applied) is up to twice as long for 62 callouts as for 10 

al l'uir< Since the corrected times for Task 2 should follow the same pattern 
*s the actual times for Task 1 (i.e., no increase in time as the number of 

ailoutH increases), this systematic increase requires some explanation^ The 
-impl€*<;t hypothesis is that the table-search-time correction applied to these 
J^^^) 1- some degree inappropriate. The linear function representing the 

>rif tion was derived from data on STs. The function may in fact be 
' iftp.H aud a different function may bo required for the other rating 
^ Mur^^ investigation is needed. 

• Mit-Mt-iUfr'fi belwt-en SKQ and RAN lot 27, 44, and 62 callouts are 
/t;;i and sizahlf iot each rating group. Furthermore, the differences 

- {u rn OH and BT samples and the ST sample with 62 callouts amount to an 

jv-t seconds for GMs and almost 5 seconds for BTs. The differences 
• ♦ .sii.^ijtH are less pronounced for the GM?? but are even more extreme for 

• It ;m tinding--that the mechanical ratings m general require more 
' • M ]f\ format ion when as many as 62 callouts are present — is 

• afivi maw havK siprmis m,^lH'ation« f'.r t i.r- v onst rut* t ion of drawings 

'i^^ ' ^ ^'^^[^l^^}^^ -"^^ ^ Idsk i atiaivHiH t r ro.»^ fi^soc t lona 1 view, 
' n ionsisti^n? .J 1 t t^*r enc ht^tween sequenti*-^! and random orders Ise.- 
* w- ji-i ^-xfiv. f fd Thnrr is .< sli>jht ♦»ftect that depends 

' ' ^ ' -•♦* d T .-iw I n>: . I i:» r t i ^ h r tuuh tu v among a 1 1 



Table 3 

Task 2, Exploded View, SEQ and RAN 
Median Response Tines: ST (Hi), ST(Lo), GM BT 



Number of Callouts 

Rating Group 10 27 4A 62 

Task 2 SEQ 

ST(Hi) 1.38 2.10 2.55 3.05 

ST(Lo) 1.20 2.30 5.25 3. AO 

CM 2.27 2.38 2.75 4.85 

BT 2.23 3.18 5.73 A. 63 

Task 2 RAN 

ST(Hi) 1.65 5. AO 8.60 7.85 

ST(Lo) 1.70 4.95 9.60 10.90 

(;M 2.05 6.25 12.15 16.85 

HT 4.05 6.A5 15.05 12.65 
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NUMBER OF CAILOUTS 

KlKutf r>. A comparison of Task 2 perfomiance of ST and GH groups on 
exploded view, sequence and random conditions. 
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10 2/ 44 62 

NUMBER OF CALLOUTS 

Ktmut' lb. A comparison of Task 2 performance of ST and BT groups on 
exploded view, sequence and random conditions. 



Tabl« A 



Task 3, Exploded View, SEQ and RAN 
Median Response T:laes: ST(Hl) , ST(Lo) , 6M, BT 







Nunber of 


Callouts 




Rating Group 


10 


27 


AA 


62 




Task 


3 SEQ 






ST (Hi) 


2.80 


3.20 


3.20 


4.00 


ST (Lo) 


3.38 


3.53 


3.50 


4.08 


GM 


3.15 


A. AO 


4.20 


4.60 


BT 


3.50 


3.55 


4.10 


5.00 




Task 


3 RAN 






ST (Hi) 


2. AO 


3.05 


3.35 


3.35 


ST (Lo) 


2.83 


3. AO 


3.65 


4.13 


GM 


2.90 


3.73 


4.58 


4.78 


BT 


3.25 


4.00 


4.15 


4.50 
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•ubjacti to c«ke longer to determine the nonencUture of • pert nerked on the 

drawing as the number of cal louts increases. It is hypothesized that this 
difference (which may be too small to be of concern) is due to two factors. 
First, as the number of callouts increases, there is a greater likelihood of 
misreading the number of the target item, due simply to clutter. Subjects 
were observed taking considerably more care with large numbers of callouts to 
ensure that they did not make mistakes. Second, there is certain to be some 
increase in the time required to locate a callout number deep in a table as 
opposed to near the top of the table. This is not as critical a function as 
searching for the name of a part in a table, for which the table-search 
correction was applied in Task 2. It merely involves locating a particular 
number in a column of numbers arranged in numerical order and reading the part 
name associated with that number. The time involved is probably quite small 
and is perhaps not of practical significance. At any rate, it is difficult to 
see how tables could be organized differently to make the process easier. 

Circling Callouts and Extending Leaders 

Circling number callouts and extending leaders to enhance visual scanning 
were expected to have much weaker effects than the sequence-random variable. 
In fact, it was anticipated that, if the numbers were in sequence, there would 
be no effect due to these "cosmetic" variations. If this were the case , then 
the C and E variables would prove beneficial only when the numbers were in 
random ord^r and when there were many callouts to scan. To test this 
hypothesis, both the sequence and random conditions for 44 and 62 callouts. 
Tasks I and 2, were examined. The results were mixed and generally 
inconsistent . 

Figure 17 shows the protiles of median response times for Task 1 with 44 
callouts in random order. This is probably the only instance from which 
clearcut conclusions might have been drawn. With the exception of the dip in 
the protile tor GMs for the circled/not extended (C/NE) condition, these 
results are what would have been predicted. This figure shows the extension 
variable to be the more powerful of the two, and circling to be superior to 
not circling. In the extended condition, callouts are placed, for the most 
part, in straight vertical and horizontal lines near the outer edges of the 
illustration (o.g., Figure D-2). Under these circumstances, one would presume 
that thf search for a particular callout number, without the cues provided by 
having the callouts in seqtience, would be enhanced by the ability to scan in 
straight lines across the top and bottom and up and dovm the sides of the 
drawing. The results in this particular instance (Figure 17) would seem to 
bear out that hypothesis: The best performance is attained when the leaders 
are extended and the numhers are circled, and the worst performance is 
att.nned when leaders are not extended and the numbers are not circled. The 
w.>rst pertortnnnce J oi earh group (NC/NK) is two to three times as long as tho 
hi s t p»' V t ormant, *• . 

hiyMxr IH profiles the med i ;in response time' for Task 1 with 62 callouts 
III ^eMueii.-e. ;\ud shows inu( h ot the inconsistency found in these results. 
K;stilt^- t.ij the 'I aiul HT samples indicate that, even with the callouts in 
•w.i.i.Mu .• <..i.n.- fit.-;! ..t the C/K vaiwition is i.res»>nt . The c<Mi(luRion drawn 
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I I I I 

CIRCLED/ NOT CIRCLED/ CIRCLED/ NOT CIRCLED/ 

EXTENDED EXTENDED NOT EXTENDED NOT EXTENDED 

CALLOUT PROPERTY VARIATION 

17. A comparison of ST, GM, and BT performance In the four circle 
extend conditions. Task 1, 4A callouts in random order. 
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CALLOUT PROPERTY VARIATION 

Figure 18. A comparison of ST, GM, and BT performance in the four circle- 
extend conditions, Task 1, 62 callouts in sequence. 
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from these profiles is that there is a negative effect on scanning efficiency 
if the callouts are neither circled nor extended. Again, the uncircled, 
embedded callout numbers in this condition would be expected to be masked by 
the features of the drawing itself. According to this figure, there is no 
detrimental effect caused by simply not extending the leaders; performance is 
degraded only when the nonextended leaders are also not circled. None of the 
effects indicated here for the sequence condition are as strong as those found 
for random ordering, as expected. The profile for the GM sample leads to 
entirely different conclusions than those of the STs and BTs. The differences 
noted cannot be reconciled using the available data. 

A detailed examination of all of the results involving circling and 
extending might, if nothing else, lead to questions that should be 
investigated more completely. Figure 19 points to one possible area of 
interest. The profile for STs generally conforms to that in Figure 19, with 
62 callouts in sequence; that is, it indicates little (if any) difference 
among the variations except for the tendency for the NC/NE stimulus to require 
a longer search time. Perhaps the most intriguing feature of Figure 19, 
however, is the similarily of the GM and BT profiles and the distinct 
difference between both of these and the STs. The circled/nonextended 
condition in this case involved a rather difficult task: locating callout 
number 11, %^ich is deeply embedded in the outlines of the drawing itself. 
Interestingly, STs appeared to have very little difficulty in locating it, 
whereas both the GMs and BTs required about four times as long. These 
differences are highly significant, and raise the question of possible 
differences in abilities of the mechanical ratings compared to the electronics 
rating. Much more investigation is required to determine the nature of these 
differences and their implications for graphic design for the various ratings. 

Although conclusions from the circle/extend conditions cannot be drawn 
with confidence, the overall data indicate that circling callout numbers and 
extending leaders are weak variables at best, even when the number of callouts 
is large, and especially if the callout numbers are in sequence. The results 
do, however, again puggest that user characteristics reflected in Navy rating 
should influence the selection of graphic presentation features. 

Zones 

The tasks performed by the subjects in this study did not lend themselves 
to tho use of zones. The subjects frequently seemed confused on these test 
items and the results are not enlightening. Comparing the Task 4 and 5 items 
with thoir corresponding Task 1 and 2 items, the items with zones invariably 
had longer search times. Zones apparently are not useful for locating parts 
when a number callout must also be used for verification. 

Thore were no significant differences among the Task 4 distributions. In 
Task 5, the C/E cell was significantly lower than the others, which would be 
reasonable except that the overall data on circling and extending leaders 
makes this finding suspect. 
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CIRCLED/ NOT CIRCLED/ CIRCLED/ NOT CIRCLED/ 

EXTENDED EXTENDED NOT EXTENDED NOT EXTENDED 

CALLOUT PROPERTY VARIATION 

ure 19. A comparison of ST, GM, and BT performance In the four circle 
extend conditions, Task 1, 44 callouts in sequence. 



Cro»t«Mct4otfl vram Exploded Views 

The NUM-SEQ and NUM-RAN conditions of the cross-sectional drawing were 
similar to the exploded-view drawings in that they had no nomenclature. This 
allowed a comparison between responses to the two drawings. For each 
number-of-cal louts step, a comparison was made between NUM-SEQ and the 
combined SEQ conditions for the exploded view, and between NUM-RAN and the 
combined RAN conditions for the exploded view. Of the 24 comparisons, 11 were 
not significant at the .05 level and .5 were significant at the .001 level. Of 
these five, four indicated somewhat longer times for the cross-sectional view. 
The conclusion is that responses to the two drawings were, for the moat part, 
very similar; either type of drawing could be used in this type of study. 
Confusing elements in this particular cross-sectional drawing probably 
accounted for the significant differences. 

Independence of Observations 

Correlations might exist in the data because the same subjects were used 
for groups of test items. If speed of response is a subject trait, and one of 
the groups of subjects happened to have a large proportion of fast subjects, 
this would be reflected in conditions scattered throughout the experiment, 
causing significant differences, not because of stimulus characteristics, but 
because of spurious subject group characteristics. Correlated data could thus 
generate an excess of significant sample differences where no differences 
really exist. 

If search speed is not a subject trait, but is instead associated only 
with test items, then the observations can be considered essentially 
independent for the purpose of performing other analyses. To assess the 
potential correlations in these data, three analyses were performed on the ST 
data using the Kendall coefficient of concordance method to calculate average 
Spearman rank difference correlations. 

The first analysis may be thought of as pairing the 36 subjects in each 
group to yield all possible pairs, calculating the rank difference correlation 
(rho) across the 40 test items, and finding the average rho of the 630 pairs. 
The average correlations turned out as follows: 



Group Average Rho 

A .74 
B .70 
C .73 
D .71 



These average correlations are significantly different from zero well beyond 
the .001 level. 

The interpretation of such a substantial average correlation is that the 
subjects reacted to the items similarly; i.e., items with short times for one 
subject tended to have short times for the others. There were "hard" items 
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and ''easy" Items; response tine Is definitely related to the test Iten. 

Additionally, the close agreement between groups Is an Indication that the 
groups were equivalent. 

The second analysis was similar, except that the test Items were taken 
palrwlse, with the correlations calculated across subjects. In this case, a 
high average correlation would mean that subjects are Individually consistent; 
that la, there are fast subjects and slow subjects. Low correlations would 
Indicate that subject responses tended to be Independent of the subject, with 
very little carryover from one test Item to another. 



Group Average Rho 

A .16 
B .13 
C .17 
D .14 



These correlations are also significant beyond the .001 level, but are 
uniformly low, indicating almost no relationship between test items. 

Taken together, these results Indicate that it is justifiable to regard 
all the scores as essentially independent measures reflecting stimulus 
characteristics. 

A third analysis confirmed the second. Because of the way the items were 
assigned to groups, certain similar items were administered to the same 
subjects. Specifically, there were 10 pairs of Task 1 Items of this type. In 
which the two items In the pair differed only In having either 27 or 62 
callouts. The correlation was calculated for each of the 10 Items, yielding 
rhos ranging from -.08 to .33. They are uniformly low, and the highest fails 
to meet the .05 level of significance, further indicating the Independence of 
the observations. 

Value of the Results 

Three questions might be raised about this investigation; 

1. Aren't the results intuitively obvious? 

2. Will the results generalize to the work environment? 

^. Fiven the longest search times are quite short; will these proposed 
gijldellnes really make much difference? 

The major findings — that numbers are easier to find if they are in 
sequence, that tables should be organized alphabetically or numerically 
depending on the user's entry Information, and that drawings should be 
tailored to different uses — seem rational and obvious. The importance of this 
study Is twofold: It provides the beginnings of an objective, numerical 
measure of the cost of violating these rational principles; and it 
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draonitratta that th« guld«ne« and rAqulr^MOta found la eurr«iie liilitary 
proeurtaent docuasnts often do not conform to the results of this study. 

With regard to the general Isablllty of the findings. It should be noted 
that the subjects* task In the experlaent was not truly a job task slnulatlon» 
but rather a saall part of an actual job task. However, the search tines 
obtained In the study are probably under estlna tea of on-the-job tines, since 
the subjects were highly Motivated to **beat the cl6ck'* In spite of instruc- 
tions to relax and pace thenselves noraally. Ordinary distractions and 
dlsconforts of the work environment were absent, and subjects* whole attention 
was on the task Itself. It Is probable that. In the work envlronnent, the 
eane relative aagnltudes or ratios would appear, but the actual search tines 
would be longer. 

Finally, even though the time for each Information search la short, these 
are small tasks that occur with great frequency, so the total time could be 
appreciable. There Is also an annoyance factor that was observed but not 
measured or recorded during the data collection; that Is, subjects who had 
trouble finding a number or nomenclature sometimes became quite agitated. On 
the job. If the use of a drawing appears to make the job longer Instead of 
shorter, or harder Instead of easier, then the technician may reject the 
drawings or the entire manual whenever possible. Every effort should be made 
to mske the data In technical manuals as accessible and helpful to the user as 
possible. 

Evaluation of the Study 

The purpose of this study was not only to generate data on which to base 
guidelines, but also to evaluate the feasibility of attempting an objective 
assessmsnt of graphic comprehension or usefulness. As a prototype for 
future Investigations, the study's approach appears to have excellent 
possibilities for solidifying comprehension requirements In technical manual 
procurement documents. The approach is different from other work In this 
area, because It focuses directly on the behavior of the technician as he 
attempts to extract needed data from a drawing. It does not attempt a 
theoretical formulation of graphic comprehension, nor does It attempt to 
operationally define stimulus features such as "density" and "clutter." It 
asks what the technician Is doing with the drawing, and what factors might 
Influence that activity. This method has the virtue of generating empirical 
relationships that should have direct application and. It is hoped, will 
provide a basis for theoretical developments regarding perception and human 
Information processing in complex environments. 

The most serious shortcoming In this study was its failure to control 
adequately for the two sources of extraneous variation: The location of the 
targets on the drawings and the position of the Information in the 
accompanying tables. The impact of target location, both on the illustration 
and in the table, was greatly underestimated. It Is hypothesized that 
systematic perceptual variations caused some target Items to take much longer 
to locate than others (notably in the random conditions) and confounded 
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c«rtiiln results. Table search tine, of course. Is part of the tJtal 
performance time, but based on data dealing only with table search time, this 
effect can be dealt with mathematically. 

Overall, the practical impact of these deficiencies is limited. The 
sequence- random effect was very strong, and leads to the conclusion that 
callouts should be arranged in sequence at all times. The hypothesized 
perceptual phenomenon is a problem only in the random conditions, which the 
results of this study suggest should never be used. It poses, at this time, 
an interesting theoretical question but not a practical one. 



CONCLUSIONS AND R£COmENDATIONS 



1, For part location by callout number, callouta ahould always be 
*^^*J««^inm«jerlcal^^ 

^•W^W^^'^W^TWIT^^Hffr^SIISS^SuSBersiS^^Ivff 

they should be in sequence on the dra%d.ng rather than in the text. If the 
nuabers are in sequence, then the nuaber of callouts may be quite large, 
certainly greater than the 62 callouts used in this study. 

2. For part location by nomenclature, nomenclature callouts may be used 
If the number of callouts is 10 or lass. Otherwise, an alphabetical table 
should be provided to key the nomenclatures to number callouts, which should 
be in sequence on the drawing. 

i. For t-art identification (finding the nomenclature when the location is 
known), nomenclature callouts are superior to numbers keyed to a table even 
when the number of callouts is so large that the drawing appears excessively 
cluttered. 

A. If the numbers are in sequence, then devices to enhance the 
discrimination and visual scanning of number callouts, such as circling and 
aligning the numbers, are probably unnecessary, 

b. Zones are not useful for locating parts whtn a number callout must 
also be used for verification. 

^. Since the guidelines differ with the type of information search, 
drawings must be designed for specific information-sear-h tasks. 

There appears to be a consistent difference between the combined GM/BT 
sample and the ST sample with regard to overall information-search performance. 
-:ince this occurs also in tasks not involving reading, more general perceptual 
■ ^r behavioral factors are responsible. These need to be identified and 

tivest i gated . 

AlthouK>i Ifsolat ; - t-he technical manual user's information-search 
•--avlors and varying t .eairures of drawings that influence search speed 
an. I arruracy appear very . romiaing, care must be taken in future studies to 
• antiocnize, rounterhalanre , or nseasure the effect of target locati^;-' in the 
^'i'liuias matt^rlnls. Inadequate control of this variable In the pr ent study 
J i'it'd r.onfoundinp In certain deslre<l comparisons, hiit need not rai. ;„» problems 
r -.r .J e St u<i i . 

' ix \ ^ {: .\' \<n. < !.<' KJ«pfiii . onipt »-h.'n« i .'n Issn. sliouM » p.ir Siu- • 
• ■ ernpirl' i' ■-■tMM— uHf^rs' Inf (-rmat it>n-Rt>ai ■ 1; h.-!.:n.' .ini the 
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APPENDIX C 
TEST-ITEM DISTRIBUTION STATISTICS 



For each table a Kruskal-Wallis k-aample teat of distribution differences 
was performed, yielding H. which is distributed «8 Chi-square with k-1 degrees 
of freedom. The result is indicated under each table. Tables for Tasks 2 and 5 
show values corrected for table-search time. 
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Test Item Distribution Statistics 
Task 1 (Point to Part Given Callout Number) 
CROSS-SECTIONAL VIEW; NUM-SEQ 



Sonar Technician Sample 



Statistic 




Number 


of Callouts 






10 


27 


44 


62 


LO Score 


0.30 


0.30 


0.70 


0.90 


Ql 


1.15 


1.00 


1.25 


1 . 70 


Q2 (Median) 


1.55 


1.30 


1.80 


2.35 


Q3 


2.00 


2.20 


2.60 




HI Score 


3.60 


3.20 


3.60 


6.50 


HI-LO 


3.30 


2.90 


2.90 


5.60 


Q3~Q1 


0.85 


1.20 


1.35 


1 .35 


N 


36 


36 


36 


36 


Group 


A 


D 


C 


D 


note, n " ly.ya. 


p < .001 (p « 


.001 for H 


> 16.27) 




Combined 


Boiler Technician and Gunner's Mate Sample 




Statistic 




Number 


of Callouts 






10 


27 


44 


62 


LO Score 


1 .00 


1.10 


2.10 


1.30 


Ql 


1.15 


1.30 


2.90 


2.65 


Q2 (Median) 


1.80 


2.90 


3.20 


3.60 


Q3 


2.05 


3.20 


4.25 


6.45 


HI Score 


3.50 


5.30 


8.20 


15.90 


HI-LO 


2.50 


A. 20 


6.10 


14.60 




0.90 


1 .90 


1 .35 


3.80 


N 


15 


15 


15 


15 


Group 


A 


I) 


C 


D 


Notp. H - 21.22, 


P • .001 (p " 


.001 for H 


• 16.27) 
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Table C-2 

Test Item Distribution Statistics 
Task 1 (Point to Part Given Callout Number) 
CROSS- SECTIONAL VIEW: NUM-RAN 



Sonar Technician Sample 



St at ist ic 



LO Score 
Ql 

Q? (Median) 
Q3 

HI Scoro 

Hl-U) 
Q3-QI 

N 

Group 



10 



0.50 
1 .25 
2.00 
2.70 
3.00 

4.50 
I .45 

3h 
B 



Number of Cal louts 



27 



0.90 
3.20 
3.80 
4.80 
14.50 

13.60 
1 .60 

36 
A 



44 



1 . 10 
4.95 
7.75 
15.60 
40.20 

39. 10 
10.65 

36 
D 



Note. H = 69.26, p 



.001 (p = .001 lor H • 16.27) 



62 



1 .20 
4.00 
6.50 
9.00 
18.30 



17.10 
5.00 

^6 
A 



fmbined Boiler Technician and Gunner 't; Mate Satrple 



; t <i 1 1 ^ 1 1 



{.ij I Med tail 

HI S. M . 
M 1 - l.i 

N 

1 , r . ■ 1 , i 





Number 


Gall outs 




H) 


27 


44 


62 


I .1(1 


1 .60 


1 .60 


.40 


1 .HU 


3.80 


4.90 


4.60 


. r> 


.00 


1 S .90 


7 . 10 


1.0(1 


8 . ) U 


> i.4'> 


1 1 . 50 


..'11 


11 .^0 


h \ .0(1 




. l! i 


lit. ^0 


hi .uO 


18 . 'Ml 


i 




1 h . • 


H 


1 •• 




1 ■ 


I •. 


I- 


A 


!• 


A 



N. 
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Table C-3 



Test Item Distribution Statistics 
Task 1 (Point to Part Given Callout Number) 
CROSS-SECTIONAL VIEW: N/N-SEQ 



Sonar Technician Sample 



Statistic 






Number 


of 


1 1 niif » 








10 


27 




44 


62 


LO Score 




1.00 


0.70 




1.10 


0.60 


Ql 




1 .20 


1.65 




2.35 


2.00 


Q2 (Median) 




1, 8b 


2.80 




3.00 


2.40 


Q3 




2.40 


3.20 




3.70 


3.55 


KI Score 




■5.60 


5.40 




9.20 


9.30 


HI-LO 




4.60 


4.70 




8.10 


8.70 


Q3-Q1 




i.20 


1.55 




1.35 


1.55 


N 




36 


36 




36 


36 


Group 




C 


B 




A 


R 


NoU' . H » 20 . 1 4 , 


p < 


.001 (p « .001 for H 


> 


16.27) 




(.omb i nt»d 


Boi I 


er Technician 


and Gunnel 






S t >j t 1st 1 >. 






Number 


of 


Cal louts 








111 


27 




44 


62 


1 .1 ' Si i>r>' 




1.10 


1 .'H) 




1 .80 


1 .90 






; OS 


2.8(J 




2.55 


3.00 


<i; I M.'.i 1 a- ' 




.•.:'(! 


i . 1 s 




3.20 


3.50 


^ 




< . :.' ') 


4 . on 




4 .05 


4.10 


H 1 S. wi 




4 .00 


7 .00 




S. ]{) 


8.30 


\>\ 1 " 






'..10 




3. So 


6,40 


I • t 




i . ,'0 






1 . 50 


1 . 10 


N 










1'- 


14 


1 • ) • Ml i 






B 




A 


B 



Table C-4 



Test Item Distribution Statistics 
Task 1 (Point to Part Given Calicut Number) 
CROSS-SECTIONAL VIEW: N/N-RAN 



Sonar Technician Sample 



Stat ist ic 






Number 


of 


Callouts 






10 




27 




44 


62 


LO Score 


0.50 




0.60 




0.60 


1.20 


Ql 


1.20 




1.20 




3.95 


4.55 


Q2 (Median) 


2.00 




2.10 




6.00 


8.25 


Q3 


2.80 




3.55 




8.65 


10.95 


HI Score 


6. AO 




7.30 




31.40 


17.00 


HI-LO 


5.90 




6.70 




30.80 


15 .80 


Q3-Q1 


1.60 




2.35 




4.70 


6.40 


N 


36 




36 




36 


36 


liroup 


D 




C 




B 


C 


WO tt. n Oj»/i.f 


p < .001 


(p = 


.001 for H 


> 






Comb i ned 


Boiler Technician and Gunner 


's Mate Sau.ple 




St at 1st ic 






Number 


of 


Callouts 






1 .) 




27 




44 


62 


LO SLore 


1 .00 




1 .30 




1.60 


3.60 


Ql 


1 .40 




1.95 




4.80 


7.70 


Q? (Mr.iian^ 


2.00 




2.90 




7.95 


10.60 




2. 70 




6.25 




14.30 


13.55 


H i Sv ort- 


4.10 




7.60 




20.90 


25.20 


H 1 ■ LC" 


1. U) 




6.30 




19.30 


21 .60 




! . Ml 




4. 30 




9.50 


5.85 


N 


1 •> 




15 




14 


15 




l> 




<.: 




B 




Nv>t . H ^ i.' .h 5. 


f. • .00 1 




,001 foi H 




1 6 . ? 7 ) 





Table C-5 

Test Item Distribution Statistics 
Task 1 (Point to Part Given Callout Number) 
EXPLODED VIEW; SEQ/C/E 







Sonar 


Technician 


Sample 




Statistic 






Number 


of 


Callouts 








10 


27 




44 


62 


LO Score 
Ql 

Q2 (Median) 
Q3 

HI Scorp 




1.10 
1.80 
2.00 
2.63 
5.00 


1.10 
1.65 
2.30 
3.10 
6.20 




0.40 
1.10 
1.25 
1.65 
4.50 


0.80 
1.40 
2.00 
2.75 
5.60 


HI-I.0 
Q3~Ql 




3.90 
0.85 


5.10 
1.45 




4.10 
0.55 


4.80 
1.35 


N 

Group 




36 
A 


36 
D 




36 

C 


36 
D 


Note. H * 31.1, 


P ^ 


.001 (p = 


.001 for H 


> 16.27) 




Combint'd 


Boil 


t>r Technician and Gunner' 


s Mate Sample 




Statist 1 V. 






Number 


of 


Cal louts 








10 


27 




44 


62 


0 Sc orr 
ty: ( Mi>d 1 an ) 
H I Si ort> 




1 . M) 
1 .^0 

: . 40 
10. wo 


2,20 
1.20 
4.10 
b.S'y 
:'0.hO 




1 .10 
1 .50 
2.00 
3.SS 
^ . 1 0 


1 .90 
2.60 
4.00 
6.95 
12.00 


H I • 1.(1 
r. < • 1,1 1 




; . 0(1 






4 ,00 
.'.OS 


1 (M 0 
4. 3S 


N 

w t ini f. 




J s 
A 


1 ^ 




r» 


15 

n 


Ni't t> . H • 1 I . M 1 , 


[• 


...I .) - 


I'i t.-t H 


1 1 . 


) 





ERIC 



Table C-6 



Test Item DUtrlbution Statistics 
Task 1 (Point to Part Given Callout Number) 
EXPLODED VIEW: SEQ/C/NE 



Sonar Technician Sample 



Statistic 




Number of 


Callout 8 






10 


27 


44 


62 


LO Score 


0.50 


0.50 


0.40 


0.50 


Ql 


1.00 


1.20 


2.00 


1.15 


Q2 (Median) 


1.20 


1.90 


3.85 


1.60 


Q3 


2.00 


3.00 


5.70 


2.35 


HI Score 


5.00 


9.00 


15.00 


4.80 


HI-LO 


/ en 

4 . 50 


o ♦ 5U 




4 30 


Q3-Q1 


1.00 


1.80 


3.70 


1.20 


N 


36 


3b 


JO 




Group 


B 


A 

A 


n 
U 


c 




n < 001 (d * .001 


for H > 16 


.27) 




Combined 


Boiler Technician 


and Gunner 


8 nace oampie 




Stat ist ic 




Number of 


Cal louts 






10 


27 


44 


62 


U) Score 


1 .00 


1.10 


1.20 


1.00 


Ql 


1 .30 


1.30 


5.35 


1.15 


Q2 (Median) 


1.60 


3.20 


8.00 


2.20 


Ql 


2. 10 


9.05 


10.45 


5.15 


HI Score 


3.20 


15.80 


28.00 


11.80 


HI-I.O 


2.20 


14.70 


26.80 


10.80 


Q3-Q1 


0.80 


7.75 


5.10 


4.00 


N 


14 


15 


15 


15 




B 


A 


D 


C 



Not.>. H « 17. '^2, p • .001 (p » .001 for H > 16.27) 



C-6 

76 



Table C-7 



Test Item Distribution Statittict 
Task 1 (Point to Part Given Callout Number) 
EXPLODED VIEW: SEQ/NC/E 



Sonar Technician Sample 



Statistic 




Number of Cal louts 






10 


27 44 


62 


LO Score 
Ql 

Q2 (Median) 
Q3 

HI Score 


0.90 
1.80 
2.45 
3.10 
6.90 


1.60 1.20 
2.30 2.25 
3.00 2.80 
4.10 3.25 
8.60 5.80 


0.70 

1.95 
3.50 

8.00 


HT-T n 

Q3-Q1 


6.00 
1.30 


7.00 4.60 
1.80 1.00 


7.30 
2.30 


N 

Group 


36 
C 


36 36 
B A 


36 
B 


Note. H ■ 12.87 


p v .Ui Vp ~ .Ui 


tor H > 11.34; 




Combined 


Boiler Technician 


and Gunner's Mate Sample 




Statistic 




Number of Cal louts 






10 


27 44 


62 


LO Score 
Ql 

Q2 (Median) 
Q3 

HI Score 


1.30 
2.15 
2.60 
5.55 
12.10 


1.90 1.60 
2.50 2.75 
3.95 3.10 
5.10 4.90 
9.80 11.20 


1.30 
1.90 
3.10 
4.60 
9.00 


HI-LO 
Q3-Qi 


10.80 
3.40 


7.90 9.60 
2.60 2.15 


7.70 
2,70 


N 

Group 


15 

C 


14 15 
B A 


14 
B 



Note. H » 1.75, p > .05 (p « .05 for H > 7.82) 



Table C-8 

Test Item Distribution Statistics 
Task 1 (Point to Part Given Callout Number) 
EXPLODED VIEW: SEQ/NC/NE 



Sonar Technician Sample 



Statist ic 




Number 


of 


Callouts 






10 


27 




44 


62 


10 Score 


0.60 


1.00 




0.90 


0.50 


QI 


1 .30 


2.00 




1.20 


2.60 


Q2 (Median) 


2.20 


2.95 




1.85 


4.65 


Q3 


3.85 


5.20 




2.90 


7.05 


HI Score 


9.00 


26.20 




7.10 


12.50 


HI-LO 


8.40 


25.20 




6.20 


12.00 


Q3-QI 


2.55 


3.20 




1.70 


4.45 


N 


36 


36 




36 


36 


Group 


D 


C 




B 


A 


Note, n * //•70) 


p < .001 (p - .001 for H 


> 






Combined 


Boiler Technician 


and Gunner 


's Mate Sample 




Stat ist ic 




Number 


of 


Callouts 






10 


27 




44 


62 


LO Score 


1.30 


1.30 




0.80 


2.20 


Ql 


2.60 


3.55 




1.90 


3.00 


Q2 (Median) 


3.80 


5.10 




2.50 


5.00 


Q3 


8.65 


7.00 




5.00 


7.60 


HI Score 


17.70 


32.90 




7.20 


18.00 


HI-LO 


\b.UO 


31.60 




6.40 


15.80 


Q3-Q1 


6.05 


3.45 




3.10 


4.60 


N 


15 


15 




14 


15 


Group 


D 


C 




B 


A 



Note. H « 7.77, p > .05 (p - .05 for H > 7.82) 



C-8 

78 



Table C-9 

Test Item Distribution Statistics 
Task 1 (Point to Part Given Callout Number) 
EXPLODED VIEW: RAN/C/E 



Sonar Technician Sample 



Statistic 




Number 


of Callouts 






10 


27 


44 


62 


LO Score 


0.90 


0.80 


2.30 


1.70 


QI 


2.00 


2.05 


2.95 


4.65 


Q2 (Median) 


2.20 


3.40 


3.95 


8.55 


Q3 


2.95 


6.25 


5,05 


16.10 


HI Score 


7.50 


15.80 


13.80 


24.20 


n J. Li\J 


6.60 


15.00 


11.50 


22.50 


Q3-Q1 


0.95 


4.20 


2.10 


11.45 


n 


36 


36 


36 


36 


vvroup 


D 


C 


B 


C 


Note. H " 48.43. 


p < .001 (p » 


.001 for H 


> 16.27) 




oomo ineci 


Boiler Technician and Gunner's Mate Sample 




Statist ic 




Number 


of Callouts 






10 


27 


44 


62 


LO Score 


1.30 


1.70 


2.10 


5.00 


Ql 


2.45 


4.00 


3.80 


7.35 


Q2 (Median) 


3.00 


5.10 


5.55 


13.90 


Q3 


4.05 


15.70 


7.50 


35.80 


HI Score 


6.80 


32.00 


19.80 


60.80 


HI-LO 


5.50 


30.30 


17.70 


55.80 


Q3-Qi 


1 .60 


11.70 


3.70 


28.45 


N 


15 


15 


14 


15 


Group 


D 


C 


B 


C 


Note. K « 2 5. 72, 


p < .001 (p » 


.001 tor H 


■> 16.27) 





Table C-10 



Test Item Distribution Statistics 
Task 1 (Point to Part Given Calicut Number) 
EXPLODED VIEW: RAN/C/NE 



Sonar Technician Sample 



Statistic 






Number 


of 


Cal louts 






10 




27 




44 


62 


LO Score 


0.90 




1.00 




2.40 


0.60 


Ql 


1.80 




2.35 




5.50 


6.25 


Q2 (Median) 


2.55 




3.30 




7.85 


9.85 


Q3 


3.35 




5.00 




13.35 


18.15 


HI Score 


6.00 




7.60 




51.20 


52.20 


HI-LO 


5.10 




6.60 




LR AD 

HO . OU 


51.60 


Q3-Q1 


1.55 




2.65 




7.85 


11.90 


N 


36 




36 








Group 


C 




B 




A 


B 


Note. H * 74.36* 


p < .001 


(p » 


.001 for H 


> 


16.27) 




Comb ined 


Boiler Technician and Gunner 






Statistic 






Number 


of 


Cal louts 






10 




27 




44 


62 


LO Score 


1.70 




2.10 




1.40 


1.30 


Ql 


2.80 




3.70 




5.55 


8.10 


Q2 (Median) 


3.20 




4.05 




8.10 


10.85 


Q3 


5.55 




5.10 




17.05 


15.30 


HI Score 


8.00 




9.10 




50.10 


43.80 


HI-LO 


6.30 




7.00 




48.70 


42.50 


Q3-QI 


2.75 




1.40 




11 .50 


7.20 


N 


15 




14 




15 


14 


Group 


c 




B 




A 


B 


Note. H - 20.82, 


p < .001 


(p - 


.001 for H 


> 


16.27) 





C-10 



80 



Table C-11 



Test Item Distribution Statistics 
Task 1 (Point to Part Given Callout Number) 
EXPLODED VIEW: RAM/NC/E 



Sonar Technician Sample 



Statistic 




Number 


Of 


Callout a 






10 


27 




44 


62 


LO Score 


1.30 


1.50 




2.00 


2.10 


Ql 


2.90 


2.20 




L in 


*f . / u 


Q2 (Median) 


A. 15 


3.20 




6.95 


6.40 


Q3 


5.55 


4.60 




12.95 


in QS 


HI Score 


23.60 


11.10 




26.50 


35.20 


HI~LO 


22.30 


9.60 




24.50 


33.10 




2.65 


2.40 






O • 


N 


36 


36 




36 


36 


Group 


B 


A 




D 


A 


Note, n " Jl.io, 


p < .001 (p « .001 for H 


> 


16.27) 




Combined 


Boiler Technician 


and Gunner 


's Mate Sample 




Statistic 




Number 


of 


Callouts 






10 


27 




44 


62 


LO Score 


1.90 


1.20 




4.00 


2.00 


Ql 


2.80 


2.80 




6.65 


6.20 


Q2 (Median) 


3.55 


3.70 




7.90 


11.60 


Q3 


5.90 


7.50 




14.70 


22.20 


HI Score 


34.20 


li.40 




16.50 


36.90 


HI-LO 


32.30 


10.20 




12.50 


34.90 


Q3-QI 


3.10 


4.70 




8.05 


16.00 


N 


14 


15 




15 


15 


Group 


B 


A 




D 


A 



Note. H » 16.42, p ' .001 (p = .001 for H > 16.27) 



C-11 



Table C-12 

Test Item Distribution Statistics 
Task 1 (Point to Part Given Callout Number) 
EXPLODED VIEW: RAN/NC/NE 



Sonar Technician Sample 



Statist ic 



1.0 Scort' 
Ql 

Q2 (Median) 
Q3 

HI Score 

Hl-LO 
Q3-Q1 

N 

Group 



10 



0 . 60 
1 .25 
1 .85 
2.80 
5.00 

A. 40 
1 .55 

36 
A 



Number of Callouts 



27 


44 


62 


0.80 


1.40 


1.60 


2.55 


4.80 


3.00 


4.85 


9.20 


6.00 


8.35 


11.20 


10.70 


46.00 


28.30 


21.20 


45.20 


26.90 


19.60 


5.80 


6.40 


7.70 


36 


36 


36 


D 


C 


D 



note 



H « 52.18, p .001 (p « .001 for H > 16,27) 



Combiin^d Boil or 



Technician and Gunner *s Mate Sample 



St at I St u 







lu 


l.u 


Slot*' 


1.10 


<n 




2.05 


Q2 


( Mod win ) 


"kOO 






4.90 


HI 


Scor»' 


1 1 .00 


HI 






Q3 


-Ql 


2.H5 


N 




IS 



A 

.01)1 ^> 



Number of Callouts 



27 


44 


62 


2.10 


5.00 


2.30 


3.35 


8.60 


4.90 


6.10 


11.50 


12.30 


21.45 


22.20 


17.95 


36 . 50 


37.10 


51.90 


34.40 


32.10 


49.60 


18.10 


13.60 


13.05 


15 


15 


15 


D 


C 


D 



,001 tor H •> 16.27) 



ERIC 



4* 




Sonar Technician Sample 



Stat ist ic 












10 


27 


44 


62 


LO Score 


0.90 


1.40 


1.60 


1.20 


Ql 


I.IO 


3.90 


2.95 


4.75 


Q2 (Median) 


l.!>5 


6.20 


5.80 


8.50 


Q3 


2.45 


8.90 


11.05 


14.75 


HI Score 


6,50 


19.50 


36.30 


40.30 


HI-LO 


5.60 


18.10 


34.70 


39.10 


Q3-Q1 


1.35 


5.00 


8. iU 


10.00 


N 


3b 


36 


36 


36 


Group 


D 


A 


B 


C 


Note. H • 59.93, 


p < .001 (p « 


.001 for H 


> 16.27) 





Combined Boiler Technician and Gunner^s Mate Saraple 



Number of Cal lotits 



10 27 44 62 





? .00 


2.10 


I .80 


2 .00 






4,85 


4 . 00 


3.80 


^ Mod 1 i - ^ 


: . 30 


9.90 


6.95 


6.10 




4,:>() 


1 2.60 


8.60 


1 7.25 




8 . 60 


18.10 


2 7.20 


28. 10 




h hO 


1 »> .00 


;5.4(t 


16. 10 




.■ . i ■' 


1 . ' » 


4 , hU 


1 J.4-> 


\ 




1 s 


14 


1 - 






A 


H 





ERIC 




$on«r Technic i«n 8«aple 



Statistic 




Nunber 


of Callouta 






10 


27 




44 


Da 


LO Score 


0.50 


0.50 




0.50 


0.60 


Ql 


0,90 


2 . 10 




0.55 




Q2 (Median) 


2.05 


3.40 




2.85 


4.70 


Q3 


2. AO 


6.65 




4.35 


7.05 


HI Score 


8.60 


19.50 




15.10 


23.90 




8.10 


19.00 




14.60 




Q3-Q1 


1.50 


4.55 




3.80 


4.35 


N 


36 


36 




36 


36 


Group 


B 


C 




D 


A 


Note. H » 27.52, 


p < .001 (p • 


.001 for H 


> 


16.27) 




f j'\«nV\ \ no/I 


Boiler Technician and Gunner 


's Nate Sample 




Statist i r 




Number 


of 


Cal louts 






10 


27 




44 




I.O Sonrr 


J .20 


0.50 




0.50 


2.90 




1 .SO 


3.90 




1.50 


3.90 


Q? ( Me4 I Hxx ) 


2.25 


5.30 




3.00 


6.00 




2.90 


8.25 




8.50 


15,55 


HI ScoT>' 


s.oo 


!0.80 




13,30 


23,20 


HI-Lt> 


.3.80 


i 0 . 30 




12.80 


20.30 




i .40 


4,"i5 




7 . 00 


1 1 .65 


N 


14 


15 




15 


15 




H 


C 




D 


A 




1 .00 1 " 


.-)0l tui H 









1 ■ • } ^ 



84 




Tttt ItM Oitiribution 8t«citticf 



CROSS-SECTIONAL VIEW: NUM-RAN 



Sonar Technician Sample 



Statistic 




Number 


of Cal louts 






10 


27 


44 


62 


LO Score 


0.50 


0.50 


0.50 


0.90 




0.80 


2.15 


5.80 


7.70 


Q2 (Median) 


1.60 


4.40 


9.25 


11.60 


Q3 


2.10 


6.75 


13.05 


13.20 


HI Score 


5.30 


19.30 


25.60 


36.20 




4.80 


18.80 


25.10 


35.30 


Q3-Q1 


1.30 


4.60 


7.25 


5.50 


N 




36 


36 


36 


Group 


C 


D 


A 


B 


Note* H « 70.71 J 


p < .001 (p • .001 for H 


> 16.27) 




f! r^m h 1 n 


Boiler Technician 


and Gunner's Mate Sample 




St at i St ic 




Number 


of Cal louts 






10 


27 


44 


62 


hO Score 


1.10 


0. Ml 


0.70 


2.70 


QI 


1 .45 


.M ^ 


3.2S 


8. 10 


Q2 (Median) 


2.80 


S. 70 




11.60 




4.20 


9.60 


12.90 


18.10 


HI Sror*^ 


4.90 


20. 10 


21 ,50 


24.70 


Hl-l.c 


KHO 


.hi) 




2 2. no 


QJ-f,M 






9.hS 


1 0 . 00 


N 


r.- 


1 1 


IS 






t 


I 


A 


i' 


N. f f . ! . i. 











ERIC 



' 1 

«5 




t ' Sonar Technician Saaple 4 



Statistic 




Number 


of 


Gal louts 






10 


27 




44 


62 


LO Score 


0.50 


2^30 




1.30 


1.80 


Ql 


1 .30 


5 .90 




6.00 


7.00 


Q2 (Median) 


2.30 


8.05 




10.25 


13.25 


Q3 


3.00 


11.90 




15.15 


17.05 


HI Score 


4.10 


104.00 




38.00 


46.00 


HI-LO 


3.60 


101.70 




36.70 


44.20 


Q3-QI 


1.70 


6.00 




9.15 


10.05 


N 


36 


36 




36 


36 


Group 


D 


A 




B 


C 


Note. H = 70.92, 


p < .001 (p » 


.001 for H 


> 


16.27) 




Comb ined 


Boiler Technician and Gunner 


s nace oainpie 




St at I St 1 '.■ 




Number 


of 


Cal lout 8 






10 


27 




44 


62 


1,0 Sforf 


1 ."jO 


1 .00 




5.70 


2.20 




J . ?o 


7 . 30 




6.70 


9.25 


Ql' ( Mfd I an > 


■^.00 


13. 10 




9.15 


15.40 




3. 90 


24.40 




14.00 


30.45 


HI ScDrt- 


4.80 


46 . 00 




21 .90 


66.80 


HI • Lu 


^ . iO 


4-1. {)U 




16.20 


64.60 


'^^ 


1 . /(> 


1 7 . 




? . 30 


21 .20 


N 


i ' . 


l^ 




14 


IS 




1 : 


A 




H 


I. 



.\. . ! . . M • ». W . II . . , i • . li : 1 t . ■ T H I fv 



Tilfli C^n 



U»t Ittk Dittribvtioti Statittiea 





CROSS- 


-SECTIONAL VIEW: 


M/N-RAM 






Sonar Technician Sample 


- . 


Statistic 






or L«iiOUI.8 






10 


27 


44 




LO Score 


1.00 


0.90 


1.50 


2.50 


Ql 


1.45 


3.25 


3.50 


6.85 


Ki4L vneoian/ 


2.05 


4.70 


5.45 


11.75 


Q3 


3.00 


7.65 


8.55 


2b, y J 


HI Score 


4.20 


14.30 


21.00 


63.10 


HI-LO 


3.20 


13.40 


19.50 


60.60 


Q3-Q1 


1.55 


4.40 


5.05 


20.10 


N 


36 


36 


36 


36 


Group 


A 


B 


C 


D 


Note. H - 78.19, 


p < .001 


(p - .001 for H 


> 16.27) 




Combined 


Boiler Technician and Gunner's Mate Sample 




St at ist ic 




Number 


of Callouts 




— . 


10 


27 


44 


0 Z 


10 Score 


1 .20 


1 .70 


2.30 


1.90 


QI 


2, 10 


3.60 


4.90 


17.25 




2.70 


6.95 


10.10 


31.00 


Q3 


3. AO 


7.80 


17.45 




HI Scurf 




16. 10 


27.10 


149,00 


hi-i.o 




14 .40 


24 . 80 


147. 10 


0^ - gi 


1 . 30 


4.20 


12.'i"S 


33.00 


N 




14 


IS 


15 


t.r oiiti 


A 


H 


K 


D 


N. . u si, •/, 






' If..:'.') 





erIc 



■^7 



..fert^k^-^^'ii 

Ttit Urn DifCributiofi Ststittict 
Talk 2 (Point to Part Civn Mo— nclttwt) 

^ ^^mum mm mm 



Sonar Technician Sanple 



Statistic 




Number of Calicut a 






10 


27 4A 


62 


LO Score 

01 

Q2 (Median) 
Q3 

HI Score 


0.50 
0.55 
1.40 
1.90 
5.70 


0.50 0.50 
0.80 1.00 
1.60 2.10 
2.70 4.25 
9.90 15.30 


0.50 
1.40 
3.10 
5.75 
50.50 


HI-LO 
Q3-Q1 


5.20 
1.35 


9.40 14.80 
1.90 3.25 


50.00 
4.35 


N 

Group 


36 
B 


36 36 
A D 


36 
C 


Note. H • 17.3, 


p < .001 (p « .001 


for H > 16.27) 




Combined 


Boiler Technician 


and Gunner's Mate Sample 




Stat 1 St ic 




Number of Cal louts 






10 


27 44 


DZ 


1,0 Scorp 
Qi 

Q2 (Median) 
HI Scorr 


0,50 
0.70 
1.10 

2.00 
6. 70 


0.50 0.50 
0.90 1.80 
2.00 2.90 
8.80 S.05 
13.90 39.60 


0.50 
2.25 
4.50 
13.20 
49.40 


HI -1-0 


6.20 
1 .30 


n.40 39.10 
7.90 6.25 


48.90 
10.95 


N 

(.roup 


14 

B 


A n 


15 
C 



H - ■ < / . p • .0'^ ( p - lor H 7.H?) 



c:-lH 



m 



Tett ItM Dihtribueloii Stttittict 

■ 1 fniin III ■! I ■■■limn 



EXPLODED VIEW: 8EQ/C/NE 



Sonar Technician Sample 



Statistic 




Dumber 


of Cal louts 






10 


27 


44 


62 


LO Score 


0.50 


0.50 


0.50 


0.50 




0.50 


0.50 


1.10 


0.50 


Q2 (Median) 


1.15 


2.60 


3.00 


4.05 


Q3 


2.00 


4.45 


5.85 


6.40 


HI Score 


3.00 


27.50 


14.40 


41.10 


HI-LO 


2.50 


27.00 


13.90 


40.60 


Q3-.Q1 


1.50 


3.95 


4.75 


5.90 


N 


36 


36 


36 


36 


Group 


C 


B 


A 


D 


Note. H « 15.03, 


p < .01 (p • .01 


for H > 


11.34) 




Combined 


Boiler Technician 


and Gunner's Mate Sample 





Statistic Number of CallouLs 



10 27 44 62 



LO Score 


0.50 


0.50 


0.50 


0.50 


Ql 


1 .50 


0.50 


2.00 


0.70 


Q2 (Median) 


2.10 


2.00 


4.:o 


1.80 


Q3 


2.95 


3.60 


7.25 


11.95 


HI Score 


4.10 


5.70 


10.30 


19.10 


HI-LCi 


3.60 


5.?0 


9.80 


18.60 


Q3-Q1 


1 .4''> 


.3 . 1 0 


5.25 


11.25 


N 


15 


14 




15 


(•r -HI [I 


{ 




A 


D 


N(l( »• . f( - 4 ■ , 1 


\ M - 


i..t It 


/.h; ) 





^ - 1 <^ 

ERIC 



T«tt It«M DittributioA Siatittiei 
T«>k 2 (Point 




Sonar Technician Staple 



Statistic 




Number of 


Cal louts 






10 


27 


44 


62 


LO Score 


0.50 


0.50 


1.00 


0.50 


Ql 


0.75 


0.90 


2.85 


0 95 


Q2 (Median) 


1.35 


2.80 


8.20 


3.10 


Q3 


2.65 


5.00 


12.60 


5.85 


HI Score 


5.70 


14.40 


20.40 


19.40 


Hl-LO 


5.20 


13.90 


19.40 


18.90 


Q3-Q1 


1.90 


4.10 


9.75 


4.90 


N 


36 


36 


36 


36 


Group 


D 


C 


B 


A 


Note. H " 29.9, 


D < .001 (d * .001 


for H > 16.27) 




Combined 


Boiler Technician 


and Gunner* 


8 Mate Sample 




Stat ist ic 




Number of 


Cal louts 




. — — ... 


10 


27 


44 


62 


LO Score 


1.10 


0.50 


0.60 


0.50 


Qi 


1.75 


2.90 


1 .60 


3.10 


Q2 (Median) 


2.70 


3.40 


2.45 


4.00 






4.30 


9,60 


4.60 


HI Score 


12.90 


11.40 


12.30 


13.20 


Hl-LO 


I 1 .bO 


10.90 


1 1 . 70 


12.70 


Q3-Q1 


4 .20 


1 .40 


8.00 


1 .50 


N 


15 




14 


15 




I) 


t". 




A 













ERIC 



Tiili-t5»21 

Tift ICM Distribution Stetittiea 



EXPLODED VIEW: SEQ/NC/NE 



Sonar Technician Sample 



Statistic 




Number of Calloutt 






10 


27 


44 


62 


LO Score 


0.50 


0.50 


0.50 


0.50 


Ql 


1 .20 


0.50 


1.10 


0.50 


Q2 (Median) • 


2.20 


0.95 


1.70 


1.25 


Q3 


3.50 






8.60 


HI Score 


18.10 


18.10 


16.20 


22.90 


U T — T A 


17 .60 


17.60 


15.70 


22.40 


Q3-Q1 


2.30 


4.95 


1.80 


8.10 


N 


36 


36 


36 


36 


Group 


A 


D 


C 


B 


Note. H • 1 .95, 


p > .05 (p - .05 


for H > 7.82) 








ooxi. lecnnician 


and Gunner's 


Nate Sample 




Stat ist ic 




Number of Callouts 








27 


44 


02 


LO Score 


0.50 


0.50 


2.10 


0.50 


Ql 


1 .00 


0.50 


3.20 


5.00 


Q2 (Median) 


2.40 


2.20 


4.20 


7.35 


Q3 


4.35 


7.70 


5.55 


17.30 


HI Score 


10.40 


15.30 


9.30 


22.60 


HI-LO 




14.80 


7.20 


22.10 


Q3-QI 




7. ?0 


2.35 


12.30 


N 


15 


15 


15 


14 


(.t .Hip 


A 


]) 


r 


B 













ti.i H • 7.82^ 



C-: 1 



ERIC 



n 



XM^V$,Mf:Zt..i,,.; 

Test ItM Distribution Statittict 
Task 2 (Point to Part Civon MoMncUturt) 



1" 



.Sj...«y^,«8H«.« 



Sonar Technician Sample 



Statistic 



Number of Cal louts 



10 



27 



44 



62 



LO Score 


0.50 


0.50 




0.50 


0.50 


Ql 


1.10 


3.55 




4.40 


0.85 


Q2 (Median) 


2.00 


6.20 




O «OU 


1 7A 


Q3 


2.75 


8.35 




16.10 


8.85 


HI Score 


5.50 


18.60 




2o .¥U 


0^ in 


HI-LO 


5.00 


18.10 




28.40 


22.60 


Q3-Q1 


1.65 


4.80 




11.70 


8.00 


N 


36 


36 




36 


36 


Group 


A 


D 




C 


6 


Note. H - 42.69, 


p < .001 (p - 


,001 for H 


> 


16.27) 




Combined 


Boiler Technician and Gunner 


's Mate Sample 




Stat ist ic 




Number 


of 


Cal lout 8 






10 


27 




44 


62 




0.50 


0.50 




5.10 


0.50 


Ql 


1 . ID 


4.95 




9.20 


1.80 


Q2 (Median) 


2 . 30 


7.70 




15.00 


7.75 




3. 70 


16.75 




27.00 


9.80 


HI Score 


6.70 


55.60 




55.50 


14.60 


HI-I.O 


b. 20 


SS . 10 




50.40 


1 A . I 0 






1 1 . 80 




17.80 


8.00 


N 


15 


1 S 




15 


14 


i'.l out! 


A 


1) 






B 



Nut 



1 ■ « •.> 



ERIC 




.3 



Sonar Technician Sample 



statistic 




Number 


of Cal louts 






10 


27 


44 




LO Score 


0.50 


0.50 


0,50 


0.50 


Ql 


0.50 


3.30 






Q2 (Median) 


1.30 


4.75 


7.85 


1.30 


Q3 


2.45 


6.45 


14.00 


4.30 


til acore 


7.40 


29.50 


54.30 


19.00 


• • ■' uO 


6.90 


29.00 


53.80 


18.50 




1.95 


3.15 


.12.50 


3.80 


N 


36 


36 


36 


36 


Group 


D 


C 


B 


A 


Note. H « 31.44, 


P < .001 (p - .001 for H 


> 16.27) 




Combined 


Boiler Technician 


and Gunner's Mate Sample 





Statistic Number of Cal louts 





10 


27 


44 




62 


LO Score 


0.50 


0.50 


0.50 




0.50 


Ql 


1 .20 


3.30 


1.10 




2.50 


Q2 (Median) 


4.40 


5.20 


6.00 




10.60 


QJ 


5.35 


6.40 


16.40 




14.05 


HI Score 


21 .20 


21 .90 


33.90 




18.80 




20. 70 


21 .40 


33.40 




18.30 


Q3-Q1 


4. n 


3.10 


1 5 . 30 




11.55 


N 




15 


14 




15 




I) 




B 




A 



H ' ;'-08, p V .OS (p » .0^ {or H > 7.8?) 



C-2 3 

ERIC 




............. .,„ ... "r"- ''■•I'.W"' •"••••:7-V-. ■ 

U$t Xttn Dittvibution StMittici 
Talk 2 (Point to Ptft Gtvn Wowiiclattty) 



-?faraf 



Son«r Technician Sample 



Statistic 




Nunber 


of 


Cal louts 






10 


27 






44 


62 


LO Score 


1.80 


0.50 






0.50 


0.50 


Ql 


3.20 


2.40 






9.05 


7.70 


Q2 (Median) 


4.10 


6.05 






18,30 


11.45 


Q3 


5.80 


9.05 






25.60 


23.70 


HI Score 


27.20 


40.60 






73.90 


56.30 


HI-LO 


25.40 


40.10 






73.40 


55.80 


Q3-Q1 


2.60 


6.65 






16.55 


16.00 


N 


36 


36 






36 


36 


Group 


C 


B 






A 


D 


Notp H * 42.4 


p < .001 (p » 


.001 for H 


> 16.27) 




Combined 


Boiler Technician and Gunner 


* 8 


Mate Sample 




Stat i St ic 




Number 


of 


Callouts 






10 


27 






44 


62 


LO Score 


2.80 


1,40 






2.70 


2 .40 


Q» 


li .45 


2.90 






10.00 


17.05 


Q2 (Median) 


6.50 


5.30 






17.10 


27.80 


Q3 


16.00 


9.50 






36.75 


56.10 


HI Score 


21.10 


15.30 






51.60 


70.50 


HI-LO 


18.30 


13.90 






48.90 


68.10 


Q3-Q1 


1 1 .5S 


6.60 






26. ;5 


39.05 


N 


15 


14 






15 


15 


Grtmp 


I' 


B 






A 


D 






= .001 tor H 


> 




.?7 ) 





c:-24 



ERIC 



^4 



Tttt ItM Distribution Statist let 



EXPLODED VIEW: KAM/MC/ME 

1 

Sonar Technician Sample 



Statistic 




NumbeV of Gal louts 

V 






10 


27 \ 


44 


62 


LO Score 


0.50 


0.50 


0.50 


0.50 




0.50 


0.95 


5.55 


5.25 . 


Q2 (Median) 


1.20 


2.90 


8.80 


13.90 


Q3 


2.60 


5.95 


13.50 


27.65 


HI Score 


6.70 


9.90 


28.10 


53.80 


HI-LO 


6.20 


9. AO 


27.60 


53.30 


Q3-Q1 


2.10 


5.00 


7.95 


22.40 


N 


36 


36 


36 


36 


Group 


B 


A 


D 


C 


Note. H » 60.91, 


p < .001 (p - .001 for H > 


16.27) 




Combined 


Boiler Technician 


and Gunner 


'8 Mate Sample 





Statistic Number of Callouts 



10 27 44 62 



LO Score 


0.50 


0.60 


3.20 


4.20 


Ql 


0.80 


1.85 


7.93 


11.60 


Q2 (Median) 


1.15 


7.70 


9.60 


14.30 


Q3 


2.00 


14.95 


24.60 


39.15 


HI Score 


6.00 


20.60 


72.00 


106.30 


HI-LO 


■^.50 


20.00 


68.80 


102.10 


Q3-Q1 


1 .20 


n. 10 


16.65 


27.5') 


N 


14 


!■> 


15 


15 




B 


A 


n 


C 



Nott>. H V td.M. p • .001 ( .ool lot H 16.;;) 



Table C-26 



Test Item Distribution Statistics 
CROSS-SECTIONAL VIEW: NOMEN 



Sonar Technician Sample 



Statistic 




Number of Callouts 






10 • 


27 


44 


62 


LO Score 


0.50 


0.80 


0.80 


1.00 


Ql 


0.80 


1.20 


2.00 


1.70 


Q2 (Median) 


1.20 


1.30 


2.25 


2.00 


Q3 


1.50 


1.95 


3.00 


2.60 


HI Score 


2.20 


3.60 


8.10 


11.10 


H T-l 

n i. LtKj 


1 .70 


2.80 


7.30 


in in 




0.70 


0.75 


1.00 


0.90 




36 


36 


36 


JO 


Group 


B 


C 


D 


A 

A 


Hoto. H « 53*94, 


p < .001 (p « 


.001 for H > 16.27) 




Comb i ned 


Boiler Technician and Gunner's 


Mate Sample 




Sr at I Kt ii 




Number of Callouts 






10 


27 


44 


62 




1 . 00 


1 .00 


2.20 


1.80 




I . 10 


1 .90 


2.70 


2.05 


(MtHiian) 


1 .50 


2.10 


3.60 


2.60 




2. iu 


2.75 


4.20 


3.55 


HI Setoff* 


i.2C 


6.90 


6.30 


4.60 


Hi • I.o 




^).90 


4.10 


2.80 




i . :o 


0.85 


1 .50 


1 .50 


N 




15 


15 


15 




H 


(.; 


D 


A 




;■ .■.Mil (p - 


.(.)()! ioi H 16 


.27) 





C-2b 

O 

ERIC 



Table C-27 



Test Item Oittribution Statistict 
Task 3 (Tell Nomencl'ature of Marked Part) 
CROSS-SECTIONAL VIEW: NUM-SEQ 



Sonar Technician San^ple 



Statistic ^ 




Number of Gallants 




1 


10 


27 


44 


62 


LO Score 


1.10 


2.30 


2.00 


4.00 


Ql . 


1.80 ' 


3.65 


3.00 




Q2 (Median) 


1 2.15 


5.00 


3.35 


6.05 


Q3 


' 3.00 


7.60 


4.25 


7 25 


HI Score 


6.00 


15.70 


6.60 


13.00 


HI-LO 


4.90 


13.40 


4.60 


9.00 


Q3-Q1 


1.20 


3.95 


1.25 




N 


36 


36 


36 


36 


Group 


C 


D 


A 


B 




p < .001 (p » 


.001 for H 


> 16.27) 

1 




Combined 


Boiler Technician and Gunner's Mate Sample 




Statistic 




Number of Cal louts 






10 


27 


44 


62 


LO Score 


1.90 


3.80, 


4.00 


4.90 


Ql 


2.90 


4.90. 


4.25 


6.10 


Q2 (Median) 


3.10 


7.00 


4.90 


7.55 


Q3 


3.80 


9.10 


6.00 


9.00 


HI Score 


5.00 


11.10 


9.60 


28.10 


HI-LO 


3.10 


7.30 


5.60 


23.20 


Q3-Q1 


0.90 


4.20 


1.75 


2.90 


N 


15 


15 


15 


14 


Group 


C 


D 


A 


B 


Note. H » 33.06, 


p < .001 (p " 


.001 for H 


> 16.27) 





C-27 



U7 



\ 

\ 

\ 

\ 

Table C-28 ' 

T«tt Xtcv Distribution Statittiet 
Task 3 (Tell NQ«enclature of Marked Part) 

CROSS-SECTIONAL VIEW: NUM-RAM 



Sonar Technician Sample 



Statistic 




Number 


of 


Cal louts 






10 


27 




44 


62 


LO Score 


1.30 


2.80 




1.80 


2.70 


Ql 


2.00 


3.80 




2.80 


4.90 


Q2 (Median) 


2.20 


4.60 




3.70 


5.75 


Q3 


2.80 


5.20 




4.45 


7.05 


HI Score 


3.80 


7.00 




6.20 


10.20 


HI-LO 


2.50 


4.20 




4.40 


/•50 


Q3-Q1 


0.80 


1.40 




1.65 


2.15 


N 


36 


36 




36 


36 


Group 


D 


A 




B 


C 


Note. H - 84.07, 


p < .001 (p « 


.001 for H 


> 


16.27) 




Combined Boiler Technician and Gunner* 8 Mate Sample 




Statistic 




Number 


of 


Cal louts 






10 


27 




44 


62 


LO Score 


2.20 


3.20 




2.90 


A. 20 


Ql 


2.95 


4.45 




3.60 


5.15 


Q2 (Median) 


3.30 


5.60 




4.15 


6.00 


Q3 


4.15 


7.45 




4.90 


7.10 


HI Score 


14.00 


9.10 




6.90 


9.30 


HI-LO 


11.80 


5.90*^ 




4.00 


5.10 


Q3-Q1 


1.20 


3.00 




1.30 


1.95 


N 


15 


15 




14 


15 


Group 


D 


A 




B 


G 



Note. H » 24.41, p < .001 (p • .001 for H > 16.27) 



C-28 



Table C-29 



Test Item Distribution Statistics 
Task 3 (Tell Nomenclature of Marked Part) 
CROSS-SECTIONAL VIEW: N/N-SEQ 



Sonar Technician Sample 



Statistic 




Number of 


Cal louts 






10 


27 


44 


62 


LO Score 


1.00 


0.80 


0.50 


1.00 


Ql 


1.50 


1.45 


1.35 


1.70 


Q2 (Median) 


2.00 


1.80 


2.00 


2.05 


Q3 


2.20 


2.60 


2.60 


2.65 


HI Score 


4.00 


4.80 


11.10 


3.60 


HI-LO 


3.00 


4.00 


10.60 


2.60 


Q3-Q1 


0.70 


1.15 


1.25 


0.95 


N 


36 


36 


36 


36 


Group 


A 


B 


C 


D 


Note. H « 2.4, 


p > .05 (p « .05 for H >' 7.82) 






Combined 


Boiler Technician 


and Gunner' 


8 Mate Sample 





Statistic Number of Callouts 





10 


27 


44 


62 


LO Score 


1.70 


1.80 


1.10 


1.50 


Ql 


2.00 


2.20 


1.80 


2.20 


Q2 (Median) 


2.30 


2.85 


2.00 


3.00 


Q3 


3.05 


3.90 


4.55 


3.35 


HI Score 


5.20 


4.80 


10.70 


6.10 


HI-LO 


3.50 


3.00 


9.60 


4.60 


Q3-Q1 


1.05 


1.70 


2.75 


1.15 


N 


15 


14 


X5 


15 


Group 


A 


B 


C 


D 



Note. H « 3.69, p > .05 (p • .05 for H > 7.82) 



C-29 

^9 



Tib It 



T«at lce« Dittributien Stttitt'ict 
Task 3 (Tall NmncUturt of Narked Part) 
CROSS-SECTIONAL VIEW! M/N-BAN 



Sonar Technician Sample 



Statistic 




Number ol^ Cal louts 






10 


27 


44 


62 


LO Score 


0.80 


0.80 


1.00 


1.70 


Ql 


1.90 


1.20 


2.05 


2.85 


Q2 (Median) 


2.30 


1.85 


2.75 


3.65 


Q3 


2.95 


2.40 


4.25 


4.50 


HI Score 


8.60 


4.00 


12.70 


12.00 




7.80 


3.20 


11.70 


10.30 


Q3-Q1 


1.05 


1.20 


2.20 


1.65 


N 


36 


36 


. 36 


36 


Group 


B 


C 


\ D 


A 




p < .001 (p » 


.001 for H 


> 16.27) 




, Combined 


Boiler Technician and Gunner's Mate Sample 

« 




Statistic 




Number 


of Cal louts 






10 


27 


44 


62 


LO Score 


2.10 


1.60 


2.50 


1.90 


Ql 


2.30 


2.20 


3.05 


3.50 


Q2 (Median) 


3.00 


2.30 


3.40 


4.10 


Q3 


4.10 


2.55 


4.70 


5.55 


HI Score 


5.10 


3.90 


6.50 


7.00 


HI-LO 


3.00 


2.30 


' 4.00 


5.10 


Q3-Q1 


1.80 


0.35 


1.65 


2.05 


M 


14 


15 


15 


15 


Group 


B 


C 


D 


A 


Note. H » 24.04, 


p < ,001 (p - 


.001 for H 


> 16.27) 
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tabit C-3I * 

Test lUoi Distribution Statiatica 
T«ak 3 (Tell Nomenclature of Narked Part) 
EXPLODED VIEW: SEQ/G/E 



Sonar Technician Sample 



Statistic 




Number of 


Gal louts 






10 


27 


44 


62 


LO Score 


1.40 


1.70 


2.10 


3.00 


Ql 


2.05 


3.05 


3.10 


4.00 


Q2 (Median) 


2.60 


3.60 


3.20 


4.35 


Q3 


3.00 


4.25 


4.00 


5.05 


HI Score 


3.80 


10.00 


10.70 


9.70 


HI-LO 


2. AO 


8.30 


8.60 


6.70 


Q3-Q1 


0.95 


1.20 


0.90 


1.05 


N 


36 


36 


36 


36 


Group 


C 


B 


A 


D 


Note, H - 69.68, 


p < .001 (p ■ 


.001 for H > 


16.27) 




Combined Boiler Technician and Gunner's Mate Sample 




Statistic 




Number of 


Callouts 






10 


27 


44 


62 


LO Score 


2.50 


2.60 


2.90 


3.10 


Ql 


2.95 


3.10 


3.20 


5.20 


Q2 (Median) 


3.00 


4.30 


4.00 


6.00 


Q3 


3.90 


5.10 


4.70 


8.00 


HI Score 


6.30 


12.00 


.8.00 


9.00 


HI-LO 


3.8v) 


9.40 


5.10 


5.90 


Q3-Q1 


0.93 


2.00 


1.50 


2.80 


N 


15 


14 


15 


15 


Group 


C 


B 


A 


D 


Note. H « 23.39, 


p < .001 (p " 


.001 for H > 


16.27) 
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Table C-'da 

Tttt Item DittribuCion 8t«tittict 
T«tk 3 (T«U )i(Mitncl«turt of Marked Part) 
CXPIODBD VIEW: 8BQ/C/1IE 



Sonar Technician Sample 









of 






# 


10 


27 




44 


62 


LO Score 


1.60 


1.80 




2.00 


2.20 


Ql 


2.25 


2.15 




2.80 


3.55 


Q2 (Median) 


2.95 


2.45 




3.20 


3.90 


Q3 


3.60 


3.00 




3.60 


4.30 


HI Score 


5.00 


3.80 




4rl0 


6.00 


HI-LO 


3.40 


2.00 




2.10 


3.80 


Q3-Q1 


1.35 


0.85 




0.80 


0.75 


M 

<i 


36 


36 




36 


36 




D 


C 




«# 


A 

A 


Note. H « 49.59, 


p < .001 <p ■ 


.001 for H 


> 


16.27) 




Combined 


Boiler Technician and Gunner 


*a Mate Sample 




Statistic 




Number 


of 


Cal louts 






^ 10 


27 




44 


62 


LO Score 


2.90 


2.30 




2*50 


3.20 


Ql 


3.60 


2.70 




3.00 


4.55 


Q2 (Median) 


3.90 


3.20 




3.60 


5.00 


Q3 


4.15 


3.95 




4.30 


6.00 


HI Score 


6.00 


4.10 




5.20 


7.90 


HI-LO 


3.10 


1.80 




2.70 


4.70 


Q3-Q1 


0.55 


1.25 




1.30 


1.45 


N 


15 


15 




14 


15 


Group 


D 


C 




B 


A 



Note. H - 22.17, p < .001 (p - .001 for H 16.27)\» 
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Table C-33 

I 

Test Item Dittribution Statittiet 
Taak 3 (Tell nomenclature of Marked Part) 
EXPLODED VIEW: SBQ/NC/E 



Sonar Technician Sample 



Statistic 




Number of Cal louts 






10 


27 44 


62 


LO Score 
Ql 

Q2 (Median) 
Q3 

HI Score 


1.60 
2.70 
3.00 
3.20 
4.60 


2.00 2.00 
3.05 2.30 
3.65 3.00 
4.00 3.30 
5.00 4,90 


2.60 
3.40 
4.00 
4.50 
10.50 


HI-LO 
Q3-Q1 


3.00 
0.50 


3.00 2.90 
0.95 1.00 


7.90 
1.10 


N 

Group 


36 
A 


36 36 
D C 


' 36 
B 


Note. H - 41.64, 


p < .001 (p 


- .001 for H > 16.27) 




Combined Boiler Technician and Gunner's Mate Sample 




Statistic 




Number of Cal louts 






10 


27 44 


62 


LO Score 
Ql 

Q2 (Median) 
Q3 

HI Score 


2.20 
3.10 
4.00 
5.55 
7.10 


2.80 3.00 
3.85 4.00 
4.20 4.10 
5.60 5.05 
7.80 8.30 


3.60 
4.20 
4.70 
5.20 
7.90 


HI-LO 
Q3-Q1 


4.90 
2.45 


5.00 5.30 
1.75 1.05 


4.30 
1.00 


N 

Group 


15 
A 


15 15 
D C 


14 
B 


Note. H - 5.51, 


p > .05 (p « 


.05 for H > 7.82) 





T«blt C-34 

Test ItMi Dittribution Statittiet 
Task 3 (Tell nomenclature of Narked Part) 
EXPLODED VIEW: SEQ/NC/NE 



Sonar Technician Sanple 



Statistic 




Nuaber of CallQuts 






10 


27 !i. 


44 


62 


LO Score 
Ql 

Q2 (Median) 
Q3 

HI Score 


1.50 
2.15 
2.85 
3.20 
4.80 


2.30 
3.20 
3.85 
4.90 
7.90 


1.80 
3.10 
3.60 
4.10 
5.50 


1.80 
2.60 
3.00 
3.45 
7.10 


HI-LO 
Q3-Q1 


3.30 
1.05 


5.60 
1.70 


3,70 

1.00 


5.30 
0.85 


N 

Group 


36 
B 


36 
A 


36 
D 


36 
C 


Note. H - 35.31, 


p < .001 (p * 


.001 for H > 


16.27) 




Combined Boiler Technician and Gunner 


's Mate Sample 




Statistic 




Humber of 


Gal louts 






10 


27 


44 


62 


LO Score 
Ql 

Q2 (Median) 
Q3 

HI Score 


2.10 
2.60 
3.15 
4.00 
4.30 


2.50 
3.90 
4.90 
7.35 
8,70 


3.80 
4.05 
4.30 
5.45 
9.20 


3.00 
3.85 
" 4.10 
4.75 
6.70 


HI-LO 
Q3-Q1 


2.20 
1.40 


6.20 
3.45 


5.40 
1.40 


3.70 
0.90 


N 

Group 


14 

B 


15 
A 


15 

D 


15 
C 


Note. H - 16.88, 


p < .001 (p - 


.001 for H > 


16.27) 
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Table C-35 

Test Iten Distribution Statistics 
Task 3 (Tell Momenclsture of Marked Part) 
SXPL0D8P VZSW: BAN/C/E 



Sonar Technician Sample 



Statistic 




Number 


of 


Gal lout 8 






10 


27 




44 


62 


LO Score ' 


1.30 


2.50 




2.20 


2.40 


Ql 


1.85 


3.20 




3 10 


3 45 


Q2 (Median) 


2.20 


3.85 




3.65 


4.05 


Q3 


2.80 


4.00 




4.15 


4-55 


HI Score 


3.20 


5.80 




5.60 


11.50 


HI-LO 


1.90 


3.30 




3.40 


9.10 


03-01 


0.95 


0.80 




1 05 


t to 


N 


36 


36 




36 


36 


Group 


B 


A 




D 


C 


Mote » H " oo.9d) 


p < .001 (p • 


.001 for H 


> 


16.27) 




Combined 

• 


Boiler Technician and Gunner 


's Mate Sample 




Statistic 




Number 


of 


Cal louts 






10 


27 




44 


62 


LO Score 


1.70 


3.10 




3.20 


4.00 


Ql 


2.50 


3.50 




4.40 


4.55 


Q2 (Median) 


2.85 


4.80 




4.90 


6.20 


Q3 


3.00 


5.75 




5.60 


12.90 


HI Score 


4.90 


7.60 




7.00 


19.70 


HI-LO 


3.20 


4.50 




3.80 


15.70 


Q3-Q1 


0.50 


2.25 




1.20 


8.35 


H 


lA 


15 




15 


15 


Group 


B 


A 




0 


C 


Note. H • 30.66, 


p < .001 (p - 


.001 for H 


> 16.27) 





C-35 
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T«bie C-36 

Tett It«m Distribution Stttittics 
Task 3 (Tell Montnclsture of Marked Part) 
BXPLODBD VIEW: RAN/C/HS 



Sonar Technician Sample 



Statiatic 




Number 


of 


Cal louts 






10 


27 




44 


62 


LO Score 


1.70 


2.00 




1.80 


1.70 


Ql 


2.00 


2.50 




3.00 


3.05 


Q2 (Median) 


.i.45 


3.00 




3.75 


3.60 


03 


3.00 


3.20 




4.10 


4.25 


HI Score 


5.00 


10.10 




5.30 


7.20 


HI-LO 


3.30 


. 8.10 




3.50 


5.50 


03-01 


1.00 


0.70 




1.10 


1.20 


N 


36 


36 




36 


36 


Group 


A 

1 


D 




C 


B 


Note. H ** 40.36) 


/ — 

p < .001 (p - 


.001 for H 


> 


10.27; 




Combined 


Boiler Technician and Gunner 


's Mate Sample 




Statistic 




Number 


of 


Cal louts 






10 


27 




44 

if 


62 


LO Score 


2.20 


3.00 




3.20 


3.00 


Ql 


2.25 


3.45 




3.80 


3.80 


Q2 (Median) 


3.00 


4.10 




4.40 


4.05 


Q3 


3.75 


5.05 




5.15 


5.20 


HI Score 


' 6.00 


8.10 




6.10 


7.30 


HI-LO 


3.80 


5.10 




2.90 


4.30 


Q3~Ql 


1.50 


1.60 




1.35 


1.40 


N 


15 


15 




15 


14 


Group 


A 


D 




. C 


B 



Note. H - 15.88, p < .01 (p « .01 for H > 11.34) 



C-36 



Table C-37 



Test Item Distribution Statistics 
Task 3 (Tell NoaencUture of Marked Part) 
EXPLODED VIEW: RAN/MC/E 



Sonar Technician Sample 



Statistic 




Number 


of 


Gal louts 






10 


27 




44 


62 


LO Score 


1.30 


1.30 




2.30 


2.50 


Ql 


1,.80 


2.60 




2.55 


«j •Ox} 


Q2 (Median) 


2115 


3.00- 




3.65 


u.oo 


Q3 


2.80 


3.60 




4.00 




HI Score 


4.00 


4.90 




5.60 


6.00 


HI-LO 


2.70 


3.60 




3.30 


3.50 


Q3-Q1 


1.00 


1.00 




1.45 




N 


36 


36 




36 


36 


Group 


D 


C 




B 


A 


Note. H - 63.6, 


P < .001 (p - 


.001 for H : 


> 16.27) 




Combined Boiler Technician and Gunner' 


8 Mate Sample 




Statistic 




• Nuab*»r 


of 


Cal louts 






10 


27 




44 


62 


LO Score 


• 1.30 


3.00 




3.20 


2.80 


Ql 


2.30 , 


3.20 




4,00 


4.90 


Q2 (Median) 


2.90 


3.50 




4.50 


6.30 


Q3 


4.00 


4.10 




5.60 


7.35 


HI Score 


7.80 


6.50 




6.10 


12.90 


HI-LO 


6.50 


3.50 




2.90 


10.10 


Q3-Q1 


1.70 


0.90 




1.60 


2.45' 


N 


15 


15 




14 


15 


Group 


p 


C 




B 


A 


Note. H « 20.52, 


p < .001 (p - 


.001 for H 


> 16.27) 





C-37 
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Table 0*38 

Test Item Distribution Statist ice 
Tssk 3 (Tell MomeucUtore-ef- Marked Part) 
EXPLODED VIEW: RAM/MC/ME 



Sonar Technician Sanple 



Statistic 




Number of Gal louts 






10 


27 44 


62 


LO Score 


1.80 


1.20 1.80 


2.20 


Ql 


2.10 


2,00 2.20 


2 

4k»JJ 


Q2 (Median) 


2.85 


2.50 2.90 


3.10 


Q3 


3.55 


3.15 3.45 


3 


HI Score 


7.00 


4.60 -6.40 


13.70 


HI-LO 


5.20 


3.40 4.60 


11.50 


03~01 


1.45 


1.15 1.25 




N 


36 


36 36 


36 


Group 


C 


B A 


D 


Note. H « 12.47, 


p < .01 {p 


» .01 for H > 11.34) 

• 




Combined 


Boiler Technician and Gunner's Mate Sample 




Statistic 




Number of Gal louts 






10 


27 44 


62 


LO Score 


2.80 


2.70 2.20 


3.10 


Ql 


3.00 


2.90 3.05 


3.55 


Q2 (Median) 


3.40 


3.10 3.90 


4.00 


Q3 


4.65 


4.10 4.80 


4.50 


HI Score 


11.70 


4.70 7.10 


6.80 


HI-LO 


8.90 


2.00 4.90 


3.70 


Q3-.QI 


1.65 


1.20 1.75 


0.95 


N 


15 


14 15 


15 


Group 


C 


B A 


D 


Note. H - 5.08, 


p > .05 (p ■ 


.05 for H > 7.82) 
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table C-39 

Teat Item Dlatrlbutlon Statlatica 
Taak 4 (Uae Zone Syateit to Point to Part Olven Callout Nuaiber) 

.Sxplodad Viair— 62 Callouta 

Sonar Technician Sample 



fitatlstlc 

ft 


RAN/C/E 


RAN/C/NE 


RAN/NC/E 


RAN/NC/NE 


LO Score 
Ql 

Q2 (Median) 

Q3 

HI Score 


5.10 
9.45 
11.90 
18.90 
39.20 


5.50 
9-05 
12.15 
16.50 
23.80 


2.70 
9.35 
12.60 
16.60 
44.10 


6.50 
8.40 
11.16 
12.50 
37,60 


HI-LO 
Q3-Q1 


34.10 
9.45 


18.30 
7.45 


41.40 
7.25 


31.10 
4.10 


M 

Group 


36 
A 


36 
B 


36 
C 


36 


Note. H - 5.07, p > 


.05 (p « .05 


for H > 7.82) 







Combined Boiler Technician and Gunner's Mate Satnple 



Statistic 



RAN/C/E 



RAN/C/NE 



RAN/NC/E 



RAN/NC/NE 



LO Score 
Ql 

Q2 (Median) 
Q3 

HI Score 

HI~LO 
Q3-Q1 

N 

Group 



X 



3.80 
17.90 
22.20 
35.70 
39.10 

35.30 
17.80 

15 
A 



9.90 
14.00 
16.55 
22.70 
44.80 

34.90 
8.70 

14 
B 



4.80 
9.20 
19.30 
34.80 
55.20 

50.40 
25.60 

15 
C 



9.10 
12 70 
17.60 
24.90 
48.10 

39.00 
12.20 

15 
D 



Note. H - 1.12, p > .05 (p - .05 for H > 7.82) 



C-39 
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' Tabl* C-40 

I««t ItM Distribution Statlttlct 
T«9k 5 <U8« Zone Systm to Point to Part Given NonencUturce) 

Exploded Vi«ir-~62 CnUotttt 

Sonar Technician Saaple 



Statistic 


RAN/C/E 


RM/C/NE 


BAN/NC/E 


RAN/NC/NE 


LO Score 


X.80 


.50 


1.60 


3.60 


Ql 


7.60 


4.70 


8.00 


11.35 


Q2 (Median) 


11.50 


14.25 


13.10 


15.95 


Q3 


17.40 


18.45 


21.30 


23.70 


HI Score 


56.60 


45.20 


81.10 


62.40 


HI-LO 


54.80 


44.70 


79.50 


58.80 


Q3-Q1 


9.80 


13.75 


13.30 


12.35 


N 


36 


36/ 


36 


36 


Group 


D 


C 


B 


A 


Note. H - 5.40, p > 


.05 (p • .05 


for H > 7.82) 







Conblned Boiler Technician and Gunner's Mate Sample 



Statistic 


RAN/C/E 


RAN/C/NE 


RAN/NC/E 


RAN/NC/NE 


LO Score 


5.10 


6.90 


7.00 


4.60 


Ql 


8.60 


19.00 


13.30 


14.50 


Q2 (Median) 


20.80 


26.50 


16.90 


21.00 


Q3 


27.40 


34.10 


28.50 


44.25 


HI Score 


68.70 


50.80 


51.30 


67.80 


HI~L0 


63.60 


43.90 


44.30 


63.20 


Q3-Q1 


18.80 


15.10 


15.20 


29.75 


N 


15 


15 


14 


15 


Group 


D 


,C 


B 


A 



Note . H 2.4A, p > .05 (p - .05 for H > 7.82) 



C-40 
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